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ABSTRACT 


ives Major dirficuities in determination of the 
steady-state properties of a Markovian queuing network by 
numerical sclution of a Set of linear balance equations are 
the choice of vector representation of the states, the 
generation and storag2 or the states, and generation, 
storage and sclution or the balance equations. 
Lexicographic sequencing of the vector representations are 
Shown in this thesis to lead to efficiencies in the storage 
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to efficient generation and storage of the states. 
Convergence rroperties or three iterative solution methods 
are examined for cyclic modeis, such as those which can 
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ieee RODUCT ION AND LITERATURE REVIEW 
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This first chapter consists of an introduction, a 
discussion of some of the notation and terminology used in 
subsequent chapters and a review of pertinent literature. 
The first section provides background information and 
motivaticn fer the work represented by this thesis. The 
second secticn is a preview of the remainder of the thesis. 
The third section, together with Appendix A, provides the 
theoretical backgrcund which justifies development of 
Dalance eguations in future chapters. The fourth section 
introduces scme of the notation and terminology used 
througnout the thesis. Aithough some of the chapters may be 
read independently of each other, an understanding of the 
Material in the fourth section is essential to all other 
Chapters with the possible exception of Chapter III. The 
final section is a review of the literature pertinent to the 


Subject of this thesis. 
toe LNTROCUCTIION 


The WWMCCS Computer Perrormance Evaluation Office of the 
Ccemmand and Control Technical Center provides support to the 
JOint Cniefs of Staff (JCS) in assessing the capapnpility of 
the Worldwide Military Command and Control System (WWMCCS) 
community to be responsive to the needs of the JCS. Asa 
part of this support the WWMCCS Computer Performance 
Evaluation Office is responsible for the development, 
procurement and utilization cf computer performance 


evaluation and measurement methodologies to investigates 
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computer system performance at WaMCCS sites. These 
methodologies are also to be used to predict the performance 
of proposed computer systems and the performance of existing 
computer systems under differing workloads and hardware 


configuraticns. 


One method available for attacking such problems is 
essentially trial and error. A proposed system can be 
assembled, or a proposed change to an existing system can be 
made, and the performance of the resulting system measured 
and evaluated. This is, however, a costly approach. Not 
only is the rental or purchase of the hardware prohibitive 
Me such practices, but also the installation cost and tine, 
and time spent in developing and implementing the required 


software, or changes in software, must be considered. 


A less costly alternative to the trial and error method 
is a method in which performance measurements are made on an 
already-existing system which is identical to, or at least 
@iace Similar to, the provosed system. This is, perhags, 
the best method. However, it is often not feasible. Either 
a similar system does not exist, or it is not possible to 
collect the needed data from it. Even when it is possible 
tc make measurements, tae type of jobs which make up the 
icad offered to the existing system may differ drastically 
from the type cf jobs which will be offered to the proposed 
System. Such differences in the job streams make 


conclusicns drawn from collected data suspect. 


Iwo other methcds involve modeiling the proposed 
ccmputer system as a network of gueves. Such gueuing nodels 
have been discussed by Gaver [36], McKinney [79], Shedler 
{100], Wyszewianski and Disney [113], and many others. Both 
analytic techniques and Simulation have been used as 


Solution procedures. 
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Analytic methods quite often require rather stringent 
assumptions which actual systems usually do not satisfy. On 
the other hand, they sometimes have a surprising (and, 
unfortunately, unpredictable) robustness which allows the 
differences Ltétween the assumptions and real life to be 
ignored. Although steady-state, or long-run average, 
measures cf performance are the most commonly attainable 
gGuantities, tranSient behavior is sometimes also derivable. 
However, this transient behavior depends upon starting 
conditions which, for most cases of interest in modelling a 
computer, are unkncwn. Fortunately, many potential 
problems, most notably bottlenecks, can be detected using 
steady-state measures. (The reader is referred, for 


example, to Euzen [ 16 ]j.) 


Simulaticn modéls have the advantage of providing an 
appealing fictorial similarity to the modelled system. By 
opserving the event-by-event occurrences during a 
Simulaticn, cne can "watch" jobs progress from queue to 
queue. The transient behavior of the system can be examined 
guite explicitiy. However, for exactly the reasons given in 
the preceding paragraph, the most useful measures derived 
from a Simulation are the steady-state measures. 
Unfortunately, for modeis of any reasonable degree of 
cciplexity, accuracy in these steady-state measures requires 
rather large running times. (Tnoese times increase at least 
exponentially with complexity.) Besides the running-time 
problem, there is often the problem of determining when the 
effect of the initial conditions has died out, so that 
collecticn of such things as waiting times and gueue lengtas 
Can begin. Many simulation models of networks of queues 
have been rerorted. The interested reader is referred to 
Cochi {26], Browne, Lan and Baskett [14], Cheng [24], Gaver 
and Shedier {41], Lavenberg and Shedler {76], and Querubin 
and Ramamoorthy [89]. This list of references, neither 


exhaustive ncr representative, consists of examples of 
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models of ccuputer systems. 


This thesis is concerned with the problems associated 
with development and numerical solution of analytic models. 
Therefore, reference will seldom be made to simulation 
efforts such as those cited above. The analytic method 
utilized threughout this thesis 1S an embedded Markov chain 
approach which leads to a system of linear balance 
eguations. These eguations can be solved for the 
Steady-state probability of finding the system in each 
State. Appropriate weighted averages of these steady-state 
prcebabilities then reveal the desired measures of system 
performance. (See Kendall [65] for a discussion of this 
technigue.) This technigue has proved to be the nost 
fruitful methed available for deriving numerical results for 
queuing preblems. Many of the references cited in the 


remainder of this chapter make use of this technique. 


Another method, one which will not be pursued here, is 
the use of diffusion approximations. The reader who is 
interested in the application of diffusion techniques to 
guéeuing netwcrks is referred to Gaver [37], Gaver and 
Shedler [42], Gelenbe [45], Kobayashi [72,73] and Reiser and 
Kobayashi [94]. 


In the simplest of queuing models, a state can be 
conveniently represented by a single number. For example, 
consider a single queue having finite capacity, N. Any 
customer, cr job, arriving at a time when there are N jobs 
at the queue, engqueued and in service, is immediately turned 
away and lost to the system. The states of the system are 
meaveniently numbered 0, 1, 2, ..., N, where the number of 
€ach state is the number of jobs at the gueue when the 


System is in that state. 


As the ccmplexity of the model increases (for examfile, 





more queues, different job types, more complicated arrival 
and service schemes), so does the complexity of the state 
description and usuaily the number of states. A vector 
representation 1s a necessary state description in many of 
these more ccmplicated cases. Many examples will be given 
in Chapter II. Also, many of the references cited in the 
final section of this chapter use vector representations. 
However, the use of a vector representation produces severe 
complications in solution procedures. For example, how can 
consideration of all states without possible duplicaticn be 
made? When using a computer to arrive at a solution 
{usually a necessity as the state spaces become large), how 
can the state descriptions and the balance equations be 


efficiently stcred? 


See PREVIEW OF THE THESIS 


In recent years the discovery of what has come to ke 
Parted @ product=-form solution for certain classes of 
problems (see subsection 5.3) has greatly simplified the 
solution of such problems by making it unnecessary to store 
and solve the balance equations. For example, if A is any 
State, then the steady-state probability or finding the 


system in state A is found to be 
(7.1) P(A) = € i) yun) 


Mreces® 1S a normalization constant, the product runs from i 


= 1to i = the number of queues, and £ is dependent ufon 
a 
the system parameters and the character of the job stream at 


muevue i, but nct upon Ain any other way. Note that it is 


Still necessary to be able to consider all of the states 
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Meenout duplication. 


A large class cf problems are not known to have a 
preduct fcrm solution (or some other simple solution fcrm). 
These are considered by many to be unwieldy because of the 
type of analytic compiications mentioned above. In Chapter 
II the complications resulting from vector representations 
are addressed and techniques are presented for finding 


numerical solutions for a wide variety of cases. 


AS previously remarked, the primary motivation behind 
this thesis involves modelling of muitiprogramming computer 
systems as networks of queues. Although many of the 
technigues discussed here are applicable to a more gen¢ral 
class of network models, the emphasis is upon the 
central-server models (see Figure 1.1), of which Baskett and 
Palacios {7] have said 

"The central server gueuing model seems to be an 
excellent model of multiprogramming even though 


the assugptions appear to be violated..." 


The physical properties of a modern computer system 
limit the number of jobs which can be considered for 
prcecessing at any given moment. Thus, even though there may 
be many jcbs waiting for processing in an external “input 
Gueue," the computer itsel= might appropriately be modelled 


as a closed nétwork of queues. 


Given such a model, the Markov chain approach discussed 
in the next section can only be applied if a state space can 
be discovered such that the time petween transitions among 
the states is exponentially distributed with a parameter 
Which depends only upon the state the system is in during 
that time. Using vectors as state descriptors leads to such 
State spaces for a large class of models. FExampies of 


vector state spaces used in this manner are found in many of 


47 








f Queues 
1.1--Closed Central-Server Network of Q 
Figure 1.1-- 
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the references given in this chapter, as well as throughout 
the thesis. Once a state space has been determined, it isa 
relatively rcutine matter to write down the balance 
equations resulting from the Markovian assumptions. [In 
principle the -alance equations may then be solved for the 
steady-state probability associated with each state, and 
composite measures of System performance may be calculated 


by taking weighted sums of the state probabilities. 


However, the complexity of many interesting models 
results in a state Space whose size preciudes “by-hand" 
solution. In solving such problems on a high-speed digital 
ccmputer, consideration must be given to the questions of 
representaticn, generation and storage of the states and the 
balance equations, as well as to the solution or the palance 


equations. 


The representation, generation and storage problems are 
addressed in Chapter II for a wide class of models for which 
a product-rora solution (or some other simple solution form) 
is not kncwn to exist. Each of these problems is considered 
first for a relatively simple central-server model (seé 
Figure 1.1) with a single first-comne-first-served 
exponential server at each gueue and with two job types 
circulating among the queues. The changes necessitated by 
various changes in the model are then discussed. The amodei 
changes ccnsidered include introduction of generalized 
Erlangian service distributions, different gueuing 
disciplines, multiple servers and capacities resulting in 


biccking (see section 4 or this chapter). 
Methods for numerical solution of the balance equations 
are considered in Chapter ZII. In this chapter the cyclic 


Nature of many problems is exploited. 


‘Chapter IV reports on three computer programs which have 
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been written uSing the methodology discussed in Chapters II 
and III. This chapter also contains numerical results 
oktained Ey running these programs. These results may be 
Weed ~O cCmpare the three models to each other as well as to 
a numerical example solved (using a product-form solution) 
by Baskett, Chandy, Muntz and Palacios [6]. Suggestions for 
approximating the models programmed by models which are 
amenable to a product-form solution may be tested using 


these programs. Some suggestions or this type are explored. 


Chapter V discusses a potential problem in gathering 
data on an actual computer system for comparison with the 
results of an analytic model. Certain data gathering 
technigues are found to be biased. Methods for estimating 
the biased results of these techniques using the results of 


the analytic model are discussed. 


mapenaltecr VI application of the work of Courtois [27] 
and others in decomposition of networks of queues is 
discussed for models which ccntain a central-server network 
as a submedel. In particular, the potential usefulness of 
solutions for the central-server submodel, as arrived at 
uSing either a product-form solution procedure or the 
technigues discussed in Chapters II and III, are considered. 


Two applicaticns are discussed. 


Finally, Chapter VII summarizes the results of the 
earlier chapters and considers open questions and areas 


where further research needs to be done. 


Before proceeding witn Chapter II, some of the concepts 
associated with the Markov chain approach to gueuing network 
prcblems, as well as the major breakthroughs in applying 
this apprceach, are reviewed. By pointing out where these 
breakthroughs cannot be applied, particular areas which 


reguire the technigues develcped in Chapters II and III are 
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revealed. Tke next section deals witn the Markov chain 
approach. Section 4 discusses the generalizations used in 
Chapter II as weil as several of the references. The final 
section outlines the history of developments in solving 
Markovian queuing network problems and discusses the major 


breakthroughs. 
3. THE MARKCV CHAIN APPROACH 


Netwcrks of gueues are generally classified as either 
open or closed. A closed network of queues is a collection 
of queues interconnected with a collection of paths. A 
fixed numker cf jobs, or customers, circulate among the 
queues aicng the paths. An example of such a network is 
represented in Figur2 1.1. Upen completing service at one 


of the gueues on the right (labelled Qu: Qe Seg ee gkele 
M 
progresses to the queue on the left, oa M5 Upon completion 
+ 


of service at Q the jod progresses to 2, with 


M+1- 
Peobability Poe ee 2, With PLPOUa oa LIt y oa and so torth. 


Since the nuzker of jobs circulating among the queues is 


mcd, p + ¢ +... +p = 1, 
1 2 M 


An open network or yueues is similar to a closed network 
except that jcebs can enter the networx and depart from the 
network. Thus, the number of jobs need not be Fixed. An 
example of such a network is represented in Figure 1.2. In 
this example jobs can enter the network at any queue and 
depart the network from any queue. Upon completion of 


Perec mateo, fOr i = 1, 2, .«.-, NM, a jobiwill proceed to 
a 
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Figure 1.2--Open Central-Server Network of Queues 
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2, ; With prokability ar, or Will leave the system with 

+ i 

Meepabality g = 1- q . Similarly, from Q a job will 
az 11 ied 

proceed to Q with probability p or will leave the systen 
a: i 


Meee prokability p SO ciaec. ~ Pp . 
M+ 1 1 M 


The models depicted in Figures 1.1 and 1.2 are called 


céentral-server mnodels, Q , being called the central server. 
M+ 


This thesis will concentrate on applications of 
central-servéer models for which the central server 
represents a central processing unit (CPU), and the other 
servers, Or queues, represent peripheral units (PPP's), such 


as tape drives, disc drives, and so forth. 


Consider now an arbitrary network of M gueves. Sujypose 
that a state space S has been chosen as descriptive of the 
possible states in which the system may be found as joks 
(possikly) enter the system, move from gueue to gueue and 
(pcessibly) leave the system. Suppose further that S$ is 
discrete in the sense that the system remains in any State i 


SamomcOL a positive time T before entering another state. 
i 


fiat 1S, let 7 be the length of time from transition into 
State ito the next transition out of state i. Then se 
= 0 where a ve Meena lsSrrTOuETOn EURCTLON OL the randon 
variable re Pemene  aastr L bution OF ae depends only upon 
the state i of the system during the time period, and if the 


meeeeotiizy og that from State 21 the system wilt next enter 
13 


State j depends only on the states i and j, then the process 
1S a Semi-Markov process and a Markov chain is embedded in 
ieee in this case, the ruture cf the process is independent 


of the past if the current state of the system and the time 


Pa 





the system has been in that state are both known. The time 
Since the last transition is necessary, in general, since 
the time until the next transition is a "residual life" and, 
therefore, not independent of the time since the last 


mpansiticn. 


However, if T is distributed exponentially, the time 

; aL 
Peeemiethe Next transition is distributed identically with T 

a 

(given the system is in state 1) and is independent of the 
length of tine the system has been in that state. In this 
case the frocess 1s a Markov process. The Komoigorov 
differential equations lead (assuming the existence of a 
steady-state distribution) to a system of linear balance 


eguations of the form: 


ar. 2) 1 ee eee oe 
ae oa Be) laa 


where, for each iin S, P is tne steady-state probability 
1 


that the system is in stat2 1. (Note that there is an 


implicit assumption here tnat S has at most countably many 
elements. Otherwise, the sum is not well-defined. In most 
qué€uing applications exponential service times will 
guarantee countability of S.) An outline of the theoretical 
considerations leading to the development of such balance 


eguations is given in Appendix A. 


Explicit examples of how a state space S may be chcsen 
in order to ensure that the times between transitions are 
exponentially distributed will be given throughout this 


thesis. In most cases the proper choice for the c's and 
5 


fees LOL USE in (7.2) will be discussed. 
13 
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G4. GENERALIZATIONS FOR USE IN CHAPTER II 


In this section the generalizations used in Chapter II 
are intrcduced. These include tne generalizations of the 
service distributions in subsection 4.1, the queuing 
disciplines in subsection 4.2, the number of servers at a 
Single queue in subsection 4.3 and the capacity of queues in 
suksection 4.4 The definitions in this section are 
essential tc a proper understanding of the remainder of the 


thesis. 


G4.1. Generalized eEriangian Service Distributions 


— a ee eee me —— —— = a = ee ey ce ee PD a Ge BE ee ee ee 


At first glance it may appear as though the desire 
to find state spaces which ensure exponential times between 
transiticns will force the exclusive use of exponential 
service distributicns and Poisson arrival processes. 
However, the wethod of stages as introduced by Erlang [13] 
and extended Ly Jensen [60]} and Cox [28] provides the 
Opportunity to use a class of non-exponential distributions 


With widely varying properties. 


Erlang suggested the use of, say, k stages of 
Service lite, with the times spent in each stage naving an 
independent identical exponential distributicn with rate 
parameter c. The distribution of the resulting service 
times has come to be called an Erlang distribution with rate 
parameter c and Snape parameter k. It iS proportional to a 


Chi-sguared distribution with 2k degrees of freedon. 


Such a distribution is generated by a queuing 


network such as that depicted in Figure 1.3. A job receives 


ZS 
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service at the first stage (OQ). immediately proceeds to the 
second stage (2,) POMmeritarieot Soevlce, and so forth through 
the k-th stage (2). The service received in each stage is 
distributed exponentially with rate parameter c. The total 


service time fer the job is measured from the time it enters 


the first stage until it leaves the last stage. 


From Figure 1.3 it may appear as though, in a 
network of queues, each qgueue with Erlangian servers cculd 
be replaced by a series of queues having exponential 
Servers. However, doing so could be misleading. For 
example, consider Figure 1.3 as depicting a network of k 
queues, and suppose that there are m jobs in the network. 
Then, in general, the m jobs could be distributed among the 
k queueS in any manner whatsoever, and there would be a job 
(possibly more than one) in service at each queue which is 
not empty. Now consider Figure 1.3 as a representation of 
the k stages cf an Erlang service distributicn at a given 
queue. Suppose that the given queve contains m jobs. If 
the queue has only one server, then only one of the m jobs 
Can be in service. Although the job in service can be in 
any of the k stages, the other mn - 1 jobs must be awaiting 


service at the first stage oe Phtse. tt Ls possible to 
have at mcst one job among the k - 1 stages 2, Le, oe and if 


there is cne among these stages, then there can be no job in 


service at Q . This is a definite contrast to tne network 
1 


of k queues represented by Figure 7.3. 


Expansion of a queuing network to include the stages 
of service at each queue having an Erlang service 
distribution can cause complications. These complications 


are unnecessary since ali that is reguired is that the stage 
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of service for each job experiencing an Erlang service time 


be included in the description of any state. 


Example 1.1 


Consider a network consisting of’a single queue with 
a single exponential server and a Poisson arrival process 
(i.e., the classical M/M/1 queue). Then the states of the 
system can be represented by the nonnegative integers. That 
is, if S(t) is the state of the system at time t, the 
possible values for S(t) are the nonnegative integers: 0, 
iueee, «--, Where S{t) = i means that there are i joks in the 
queue at time t. (if 1> 0, exactly one of these jobs is in 
memeice.) Note that after being in state i for an | 
exponentially distributed time, the system will enter eéither 
Seagate 1 -~ 1 (1f 1 # 0) or state 1 + 1. 

Now suppose that instead of exponential service, jobs 
at the queue experience Erlang service with shap2 parameter 
k = 2. Then the state of the system at time t can be 
described by a paix of integers S(t) = {i,j} where i= 0, 1, 
2, e+. Llepreszents the number of jobs in the gqueve and j = 
1, 2 represents the stage of service of the job in service. 
If i= 0, let j = 1 by convention. Then the possible states 
of the system are; Opera, cll p2ag 2G iy £252}, 
Meh, «2. df S(t) = {0,1}, then after an exponentially 
distributed length of time the system will transition into 
Beate {1,1}. If S(t) = {1,1} for i # 0, then after an 
exponentially distributed length Oe ele the system will 
transiticn ¢€ither to state {i+1l,1}, by having another job 
arrive, or to state {1,2}, by having the job in service 
"Ccmplete the first stage of service and enter the seccnd 
meages' Simailariy, if S(t) = {1,2} for 1 # 0, then after an 
exponentialiy distributed length of time the systema will 
MBieansiticn ¢€ither into state {i-1,13, by having the jor in 


service ccmplete service and leave the system, or into state 
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{2+1,2}, Ey having another job arrive. 

Now suprose that the service distribution is 
exponential but that the interarrival times have an Erlang 
distribution with shape parameter k = 2. Then the state of 
the system at time t can be represented by a pair of 
integers S(t) = {1,3}, where 1= 0, 1, 2, ... represents the 
number of joks at the gueuve and j = 1, 2 represents the 
stage of interarrival. This is most easily visualized as a 
two queue series network in which the first queue always 
contains an infinite number of jobs and has a single 
two-stage Erlang server. The second queue is the queue of 
the original system and has a single exponential server. 
Since the number of jobs at the first queue never changes, 
there is no need to include this number in a state 
description. However, since there are two stages in the 
Service distributicn at this first queue, any state 
descripticn should indicate the stage or service of the job 
in service there. This is what is represented by the second 
component cr the provosed state description. The possible 
States are: Hopmie, fOee}, fl, ity fiz2}y7 {2,1}, «<2. Fron 
State S(t) = {0,1}, the system will transition after an 
meeenentially distributed length of time to state {0,2}. 
Frcem state {0,2}, the system will transition after an 
exponentially distributed length of time to state {1,1}. 
Paes tast transition corresponds to arrival cf a job at the 
Original gueue. From state {1,1} with i # 0, the systen 
Wili transition after an exponentially distributed lencth of 
time either to {i,2}, by having the interarrival time enter 
the second stage, cr to {i-1,1}, Dy having the job in 
service at the (original) queue complete service and leave 
the system. Similarly, from state {1,2} with i # 0, the 
System will transition after a exponentially distributed 
length of time to either {it+t1,1}, by having another jok 
arrive at the queue, or {i-1,2}, by having the job in 
Service at the queue complete service and leave the systen. 


MmiemGaceeinewhich OSOzth the Service distribution and the 


Pats, 





interarrival distribution have Erlang distributions requires 
a three-ccmpcnent state descriptor. Two components are for 
the stage of the service distribution and the interarrival 
distribution, and the other component is for the number of 


joks at the gueue. 


The conclusion that the times between transiticns 
are exponentially distributed in Example 1.1 is based upon 
the well-kncwn fact that the minimum of two (or more) 
exponential random variables is exponentially distributed 
With rate parameter whicn is equal to the sum of the rate 
parameters of the distributions of the two random variables. 
(This is €asily proved using standard probabilistic 
techniques. It is done, though not pointed out, in Barlow 
and Proshan [4]. It is done for the case that the randon 
variables are independent and identically distributed in 
Jchnson and Kotz [61].) Note that, even in the simple cases 
discussed in Example 1.1, tne rate parameter of the 
distribution cf time between transitions depends upon the 
State of the system during that time--at least up to whether 


Or not there 1S a job at the gueue. 


Jensen {60] discussed a generalization of the nethod 


of stages in which the rate parameters are allowed to vary 


Maem stage te stage. Referring again to Figure 1.3, this 

involves aliowing c. # c for i# j, where the distribution 
- J 

of service at stage 1 15 exponential with rate parameterc . 


ab 


Sox 20) Cabeied the method Of Stages to its 
ultimate by showing that any iife-time random variakle whose 
moment generating function is a ratio of polynomials can be 
modelled as a netwerk of exponential stages as depicted in 
Pagure 1.4, (X is a life-time random variable if Prob {x20} 


= 1.) In Figure 1.4 a job experiences a zere service time 
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Ofeesecrvice) with probability 1 - aoe 


ones |) eek Geeet sd JOD 


experiences exactly j stages of service (each of which is 


exponentially distributed 


parameters) with probability peeee (te P i 
J + 


With possibly different rate 


A job 
1 J 


experiences all k stages of service with probability 


Now let X pe a life-timze random variable having 


mete roution function F(x) 


Gcmadomsaty (lf 1c exists) £(x). 


Then the mcment generating function of X is the 


Laplace-Stieltjes transforn of F(x): 


te 5) F¥(s) = 


Ss =s x 
{ 3 Oe Te 


epeett the density runction exists, the Laplace transform of 


e(x): 
=a hae 
fae 4) F* (s) - | é 
0 
meet (xX) exists, 


the two integrals are identical.) 


i SCG 


F* (Ss) 1s 


memmeto be a rational function if it is the ratio of two 


polynomials ins. 


MmemGeton of a life-time random variable forces the 


the polyncgial in 


Phrestact that Ff (x) 


is the distribution 


degree of 


the numerator to be no larger than the 


degree, say k, of the polynomial in the denominator. 4s a 
moult, r*(s) can be expanded in partial fractions as: 
k SL 
(7.5) Peed too) + 2 Pp p_»--Pp.(I-p.. .) Tie /(¢_+s) 
1 Nee a eae j J 
1=1 j=1 
where p peureeanaWiiere C , C , «ss, © are the kK roots of 
k+1 1 Z 
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the polyncmial in the denominator of F¥(s). The moment 
generating functicn of a random variable having the 


=ex 
exponential distribution function, G(x) = 1i-e yo as: 


1.6) G*(s) = c/(cts) 


As a result, (1.5) is found to pe the moment generating 
function of a random variable whose distribution can be 
dépicted in Figure 1.4 with exponentially distributed 


Sreages. In particular, the distribution at stage Q is 
a 


exponential with rate parameterc. 


eke 


Nete that since, in general, a k-degree polynomial 
Cannot be guaranteed to have all of its rocts on the 
negative real axis, it is conceivable that life-time randon 
variables exist whose moment generating functions are given 


fees >) With complex valued p *s and c 's. Indeed, Cox 
Al 1 


gives the fcllowing example in which two of the c ‘'s are 
\ iz 


ccmplex. 


Bxemple 1.2 


Genc2 ger a Life=-tine random variable X with 


Becbability density function 


cuz 2 id x 
(1.7) Hise (ata +b })/b } e (l=cos bx) 


ror x 2 0 and £(x) = 0 for x < 0. Then the moment 


generating function of X is 


2 2 2 2 
(8) F¥(s) =[a(a + b)j/ {({ats){ (ats) + b j} 
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Which is in the general form given in (1.5) with Ey = Be - 


EE = 1. Note that the denominator of F¥(s) has two complex 


roots, atti and a~bi. 


In ccmmenting on the use of complex probabilities, 
Cox points out that the decomposition into stages is an 
artificiality, and that there is no real concern about the 
probabilities and rates connected with the individual 
stages. The concern is rather about the process as a whole. 
fora 2S, Frobv{X S x} is a real probability even though the 
the probability of X "lasting" two but not three stages may 


formaliy re ccmplex. 


Ncenetheless, the use of the method of stages with 
complex rates and probabilities leads to complex 
coefficients in the balance equations (see eguations (71.2)) 
even though the variables, the steady-state probabilities, 
are assumed to be real numbers between zerco and one. Much 
of the numerical analysis presented in Chapter III of this 


thesis trequires real positive rates and nonnegative p_'s. 
st 
For this réason a tacit assumption will persist throughout 


Magee the ¢c ‘Ss are real and positive and that the p ‘'s are 
a a 


Meebadbilities. To wit, the definition: 


A randcm variable X is said to have a generalized 
Erlangian distribution if it can be represented as 
a series of stages as depicted in Figure 1.4 with 
y SC Deo Or 2 = 2, 3, »~.6, K, and the 

a 
holding time at stage Q exponentially distributed 
a 
MinetmeeaecmG > 0 fOr 1 = 1, 2, «sey Ke 


1 
(The restriction B = 1 avoids zero service times.) 
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Several other representations of service times in 
terms of expcnential stages are possible. A "parallel 
stages" representation, as depicted in Figure 1.5, is cne 
example. (Ccx mentions that this case is also derivable in 
terms of a rational moment generating functicn so long as 
the roots of the denominator polynomial, or equivalently, 
the rates of the exponential stages, are distinct.) Another 
series representation would allow the service time to begin 
in any stage (see Figure 1.6). Still another representation 
would alicw “movement" from any stage to any other stage. 
Cox Shows that this last case is equivalent to the case 


considered in Figure 1.4 with the c 's and p 's 
sh aL 


appropriately redefined. 


Althcugh any of these alternative representaticns 
could be considered as easiiy as the one defined above, only 
the cases covered Ey the definition given will be explicitly 
considered in this thesis. The reason for this is 
threefold. First, distributions as depicted in Figure 1.4 
have been considered by other authors. (See Baskett [5], 
Meekett, Chandy, Muntz and Palacios [6], Litzler and Wemack 
Mmeoejand Moore {81].) Second, considering a variety of 
representaticns cannot add clarity to the discussion of 
generalized Erlangian service distributions Later in this 
thesis. And third, once the development of the balance 
equations has been mastered for the present case, extension 


to these cther representations is straightforward. 


4.2. Queuing Disciplines 


An important property of each gqueve is its yjueuing 
miecipiine; that is, the rule or set of rules which 
determine the order in which arriving jobs are served. The 


queues encountered by people in their daily lives usually 


35 








meomre l,o-=-Parallel Network Representation of a 


fenomalazed Erlangian Distribution 
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have some variation of the first-come-first-served queuing 
discipline discussed here. In such queues it is often 
impractical or imprudent to depart too far from such a 


queuing discipline. 


Hcwever, quite a variety of queuing disciplines are 
meeerole Lor use at the processing units of a high speed 
multiprogrammed computer system. For this reason much work, 
both theoretical and empirical, has been undertaken in an 
effort to determine the relative advantages and 
disadvantages of various queuing disciplines. No attempt is 
made here to review the literature in this area. The 
interested reader is referred to Kleinrock, Muntz and dsu 
[71], Litzler and Womack [78] and Sherman, Baskett and 
Browne [101]. In this subsection the queuing disciplines to 


be studied in Chapter iI are introduced. 


At a queue having a first-come-first-served queuing 


> gee ee ce ee ee: ee ee ee ee Se = 


discipline (hereafter referred to as FCFS), the arriving 
jects enter service in the same order that they arrive at the 
gueue. Cne of the best examples of a FCFS queue is the 
Check-out counter at an old ma-and-pa corner grocery. 
Igncring the lane switching phenomena, the check-out 
counters cf a modern grocery store forma paraliel 
connecticn cf FCFS queues. A customer joins one of the 


Menes and awaits his or her turn to check out. 


Mescipline (hereafter referred tc as LCFS), an available 
server always serves the job which has been waiting for the 
ie~pnest period of time. This is in contrast to the FCFS 
queues woere service wiil always be extended to the jock 
Which has had the longest wait. At a LCFS queue a 
foey-arniving job will join the front of the waiting line 
if all servers are occupied. As described here, the LCFS 


quéuing discipline is nonpreemptive in that the service 
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received by a job cannot be interrupted. However, two 
variations cf preemptive LCFS queuing disciplines will be 


considered in Chapter il. 


At a queue having a preemptive LCFS queuing 
disciplire, a newly-arriving job interrupts the service of 
scme other job if no servers are available. The job which 
has been preempted in this manner then joins the waiting 


line, usually at the front, to await an available server. 


first-served=- 


preemptive-resume (LCFPSPR) discipline, a job whose service 
has been interrupted resumes service at the point at which 
the last interruption took place. Thus, the service time 
from resumption of service (given no further interruption) 
has a residual life~time distribution. In the case that the 
(uninterrupted) service times are exponentially distrituted, 
these residual life-times are identically distributed with 
the uninterrupted service times. In the case that the 
service times have a generalized Erlangian service 
distributicn (see subsection 4.1), the job resumes service 


in the stage cf service it last occupied. 


A natural companion to the LCFSPR discipline is the 
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discipline in which a job must "start from scratch" each 
time it receives service. Unfortunately, such a discirline 
destroys the renewal character of the gueuing system, and it 
1s this renewal character which permits the use of the 
embedded Markov chain approach discussed in section 3. The 
Ma-On LOr this, aS pointed out by Gaver [35], is that the 
Service time of a job whose service was previously 
interrupted is constrained to be at least as large as the 
amcunt of service time received prior to the interruption. 
AS a rough approximation to such a Situation, however, 


LCFSPRpt wiil be used to refer to a preemptive LCFS queuing 
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discipline in which a previously interrupted job is 
constrained to experience all stages of service previously 
entered, but not constrained to spend the amount of tise in 
a stage that it previously spent there. For example, 
suppose a LCFSPRpt gueue has a generalized Erlangian service 
distribution as depicted in Figure 1.4 with k = 5 stages. 

If the service of a joo is interrupted while it is in the 


third stage (QO). then that job is constrained to experience 

service "at" Qu e., and 2, (unless again interrupted before 

Meotering" Q or 2.) each time it receives service, until it 
a 


finally ccmpletes its service time at that queue. In effect 


oy p and De are each restricted to be equal to one for 
this job until its service time is complete and it leaves 
the queue. But each time it enters OG for example, 1% 
receives a different (exponentially distributed) service 


memes there. So defined, LCFSPRpt 1s identical to LCFSPR if 


the service times are exponentially distributed. 


short, if different classes of jobs enter the queue (or 
entering jobs are assigned to different classes), and joobs 
in some class always receive service before jobs in some 
Sener Class. Such disciplines exist in military life and 
fall under the catagory or "rank has its privileges." For 
example, if an admiral and an ensign are both waiting for a 
Maenrcut in a military barber shop, the admiral will be 
served first, even iz the ensign arrived first. In computer 
Systems it may be desirabie to give short-running jobs 
priority cver longer-running jobs at a central processing 
unit. This example points to the fact that different 


Classes of jcbs may have different characteristics at the 
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queue, fcr example, different service disciplines. 


As with the LCFS disciplines, priority gueuing 
disciplines may be either preemptive or nonpreemptive. fhe 
ccBments concerning LCFSPR and LCFSPRpt disciplines apply in 
this regard. Whetner preemptive or nonpreemptive, if the 
queuing discipline 1S priority, the waiting jobs with 
highest priority will be at the front of the line; and those 
with the lowest priority will be at the back. 


fany priority schemes have been devised. Indeed, 
different computer manufacturers recommend different 
schemes, and different computer facilities having the same 
computer system often employ different schemes. In general, 
the techniques to be studied in Chapter II can be applied if 
mmencidSS, CL priority, of a job does not change once it 
enters a gueue. These technigues can also be applied in 
some cases 15 Waich priority changes take place. However, 
in other cases, such as the interesting ones suggested py 
Saerson (5/7 ] and Kieinrock and Finkelstein [69], the renewal 
Character of the system is disturbed and the technigues 


cannot be apelied. 


Many articles have been written about the so-called 
round-robin (RR) queuing disciplines in which each job at 
the queue is, in succession, given a burst or service cf 
fixed length gq (or less if less is required to complete the 
service of the job). Among the authors which compare the R&R 
disciplines to other disciplines are Kleinrock [67], 
Kleinrock and Muntz [70] and Rasch [90]. The advantage of 
meme a discipline is that short-running jobs do not wait in 
queues for excessive periods of time while lcng-running jobs 
are receiving service, and long-running jobs are not 
engueued for excessive periods of time while short-running 
JOES, given a higher priority, return to the gueue time and 


time again keeping them at the back of the iine. The size 
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of q should ke kept short enough to allow short-running jobs 
to pass through the queue in a reasonable time, and yet long 
enough tc prevent system overhead (time spent shifting from 
job to job rather than working on jobs) from becoming 
excessive. System overhead is considered in the models by 
Heacox and Purdom [51]. Some of the literature on RR 


disciplines is concerned with "optimal" choice of q. 


Unfortunately, the fixed length, g, of the service 
burst disturks the renewal character of models of such 
queues. This makes a successful embedded Markov chain 
approach Fased upon a continuous time Markov process 
unlikely. Using some simplifying assumptions concerning the 
relationship Eetween gq and the service time distributions, a 
discrete time Markov chain approach can be used to analyze 
RR gueues. Such an approach has been used by Bhandarkar 
{10] and Baskett and Smith [8]. Discrete time parameter 
methods are not discussed in this thesis. The reader is 
referred to a series of articles by Neuts [82], Neuts and 
Klimko [83,84] and Neuts and Heimann [ 85}. 


However, totally ignoring system overhead and 
allowing the length of service burst q to approach zero, a 
meiLting® queuing discipline, referred to as processor 
Sharing {FS), results. One description of a PS discipline 
meee "in a period of length t, in which the number of jobs n 
at the queue does not change, each job receives service of 
length tyn; that is, each job receives (i/n)-th of the 
service effort of the queve." The effect of such a 
descripticn is that if a job has service time distributed 
exponentially with rate c, its waiting and service time is 
distributed exponentially with rate nce so long as there are 
mM jobs at the gueuve. It 1S in this context that the PS 


me-urag discipline wiil be used in this thesis. 


A generalization of this concept is given by Kelly 
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[64]. O'Lonovan [ 86} has suggested several models of a 
precessor sharing gueue. A bibliography of modeis of 


processor sharing gueues is contained in Babad [3]. 


= eae ee ee ~~ a = a 


Having discussed service distributions and queuing 
disciplines, consideration must now be given to another 
property of gueues, the numpeér of servers. Consider a queue 
Which has m 2 1 servers and one of the gueuing disciplines, 
other than PS, discussed in the preceding subsection. Then, 
if there are n joos at the queue, the number of these jobs 
receiving service is n, if n < mw, and m, if n> om £4The 


mamoeer awaiting Service is 0, if n < m, and n- am, if n> oo. 


AS pcinted out above, the check-out counters of a 
large grocery store form a parallel system of FCFS quetes. 
By way of contrast, some banks (and post offices) have a 
Single waiting line for all tellers. The first customer in 
line moves tc the next available teller. This is an example 


Or a Single multiserver FCFS queue. 


“hen the number orf servers is at least as large as 
the maximum number of jobs which can pe at the gueue at a 


time, the gueuve has wnat is called an infinite server {IS) 


—_— So a ee ee ee a 


are an infinite number of servers if the gueuve has a finite 
capacity, or if it is in a closed network of gueuves. When 
the number of servers at a queue becomes (effectively) 
infinite, all queuing disciplines act the same way. This is 
Why IS is considered to be a queuing discipline. Aliso, 
nctice that a PS queuing discipline is an IS queuing 
discipline in which the service degrades each time anotaer 


jok arrives and improves each time one leaves. 
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Qn the other hand, a PS queue can also have multiple 
servers. For example, suppose a PS queue has m servers. 
Then, if there are n jobs at the queue, each job receives 
its full measure of service (as though the gueue were an IS 
gueue) if n < mw, and ({m/n) times its full measure of service 


mon > tt. 


a a 


is, the maximum number of jobs which can réside at the queue 
{both in service and enqueued) at any given time. Ina 
Single-queue system jobs which arrive when the queue is at 
Capacity are turned away and lost to the system. Scme 
authors have incorporated this same idea into queuing 


networks. 


Fer example, Hannibdalsson [49] examines a netwerk of 
we queucs, as depicted in Figure 1.7, both having finite 


Capacity. A newly arriving job enters the first queue (OQ) 
if there are fewer than N jobs (the capacity of Q.) engueued 
and in s¢rvice there. If N jobs are at 2, when a joo 
arrives, the job immediately leaves the system. (The input 


precess is Pcisson and both queues have FCFS exponential 


servers.) A jcb completing service at oo leaves the systen 
With probability (1 - p) or proceeds to the second queue 
(C.) weepepectapzlity gp. ff it finds M jobs (the capacity 


OL oe already at Q., wnen it arrives, it will leave the 


system. A job completing service at 2, wii Eecturn tO op 


4 





otduexg s 


UOSSTVQCTUUBR]] UT YIOMION---/°T oans ty 


MOTJIOAO 





MOTJ1I9A0 


45 





where it will be treated as though it were a newly arriving 


BOE. . 


The advantage of imposing capacities on queues, or 
cn a gueuing network as a whole, 1s that doing so very often 
yields a finite state space. For example, in Hannibalsson's 
model’ (Figure 1.7) the states of the system can be 
described in terms of ordered pairs (n,m) of nonnegative 
integers such that n is no larger than N and m is ne larger 
than M. Thus, the number of states which need be considered 


1s no larger than (N+t1) x (M+1). 


In closed networks of queues this same advantage is 
enjoyed. The number of states is finite (in many cases) 
Since the nusber cf jobs is fixed. Reiser and Kobayashi 
{93] discusses a "semi-closed" network of queues in which 
the total number of jobs 1S constrained to be no larger than 
fmemaed no smaller than k*. A job is turned away if it 
attempts to enter the system when kK" jobs are already tnere. 
Similarly, a job is not allowed to leave the system if there 
are k*' jobs in the system (including it). These 


restricticns lead to a finite state space. 


Since a treatment such as that of Hannibalsson, in 
Which any job encountering a queue at capacity leaves the 
system, is net usable in a closed network of queues, 
additional ways of handling gueues with finite capacity in a 
network are needed. One possibility is to allow a job to 
"skip" any queue which is at capacity. For example, 
consider the closed network depicted in Figure 1.1 with N 


fees Circulating in the system. Further, suppose that Q 
ofp 


Meena Gapacity of o < N jobs. Any job completing service 


ee, Say, © when there are n jobs at Q Wwiil Skip Q ’ 
1 M+ 1 M+1 





experiencing neither waiting time nor service time, and 
proceed immediately to 2. Wee Nee E Oba Da Lt ¥ a se with 


Pmepanility ~- , and so forth. If one or more of on Q» 
z 2 


a e, are also at capacity, the analysis becomes a little 
more complicated, but the idea is the same. The "service 


deletion" mechanism of Jacxson [61] is eguivalent to 


skipping as described here. 


Skipping seems a little arbitrary. However, another 
alternative exists, that or blocking. Again consider the 
example intrcduced in the preceding paragraph, except that 


jobs are not allowed to skip. Then a job ccmpleting service 


ae Q. When there are n jobs at Q ; is blocked from entering 
M+ 
Q until a job leaves Q - Hence, it must remain ato. 
M+ 1 Wes) 1 


In turn, the blocked job continues to occupy a server (the 


server, if there is only one) at Que thereby blocking jobs 
engueued at a. from receiving service. Cie Om, 2, could 
serve as an "overflow waiting room" for Oa and, in effect, 
the capacity of ae would be increased.) A sinple 
l 

twc-queue model with blocking has been discussed py Adiri, 
Meett and Yadin [1 }. 

A prcblem which can arise in networks with blocking 


1s deadlocking. Again consider the example discussed above. 

igo Q. is aisc at capacity and has a single server, no job 

Can receive service at , until a joo leaves Q 1" 
M+ 


unblocking the job at Q@ , and allowing it to proceed tc 
1 
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Q mr ouEpose that 0 also has a single server, and that 
M+ 1 M+1 


a job completes service at or and is destined for oe 
+ 
Since Q. is at capacity, this job is blocked and blocks any 
further service activity at Q re Thus, the two queues are 
M+ 


blccking each cther and no service activity can take place 


in é€ither. This is called deadlocking. 


Gordon and Newell ({ 47] discussed a closed cyclic 
network cf queues (jobs leaving queue i proceed only tc 
queue 1 + 1; jobs leaving the last queue proceed only to the 
first gueue) in which one or more queues have finite 
Capacity and blocking results. However, as formulated by 
Gordon and Newel, a blocked job must repeat service while 
Waiting te be unblocked. Hence, unlike the blocking mcdel 
discussed abcve, only one job can move between gueues at any 
instant. Resuits are given only for some special cases of 
the cyclic mcedel discussed. This and the fact that very few 
authors address blocking bear testimony to the analytic 


Seericulty of the subject. 


Nenéetheless, models invoiving blocking and queues 
having finite capacity are appropriate in the computer 
world. Ueadiccking, tor example, is discussed by Havender 
[50] as a real problem in multiprogrammed computers. [In 
Chapter II scme space will be devoted to modelling in cases 


invclving blccking and queues with finite capacity. 
5. REVIEW OF QUEUING NETWORK LITERATURE 


This section ccnsists of a review of the major papers on 


the subject cf queuing networks, particularly Markovian 
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queuing netwcrks. No attempt has been made to be exhaustive 
in this review. Indeed, in many cases where some particular 
work summarizes and extends earlier works, only the most 
recent (or, in some sense, the most complete) is cited. 
These interested in extensive research into this subject 
could use the references in this section and earlier 
sections as a starting point and investigate the references 


in the cited works for further depth and background. 


BeeaA. Torbett {105] in an appendix to his PhD thesis has 
an excellent review of some of the early research in queuing 
networks. The first supsection of this section parallels 
Torbett's appendix, although the emphasis here differs 


somewhat frog that in Torbett's work. 


The remaining subsections are arranged mere by proktlen 
approach than chrcenologically. A very good review of this 


material has recently been published by Lemoine [77]. 


One cf the mnoSt important features of any network of 
queues is that the output stream from certain of the jueues 
contributes to the input stream at certain other queues. As 
a result it is hoped that known results concerning 
individual gueues will be applicable in studying networks of 
such queues. In this regard it 1s apparent that some 
Knowledge of the departure process of an individual queue is 


reguired. 


Burke [15] took the first step in setting the stage 
for the study of Markovian queuing networks. He 
investigated the departure process from a single FCFS gueue 
With multiple (identical) exponential servers given a 


merssOn arrival process. Assuming that the traffic 
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intensity (tke ratio of the arrival rate to the maxinuao 
service rate) is less than one, so that steady-state exists, 
Burke prceved that tne steady-state departure process is 
identical to the Poisson arrival process and independent of 
the gueue size left by a departing job. Since the 
steady-state distribution of the queue size for the M/M/s 
queue is welj-known (see Kleinrock [68], for example), the 
implicaticn of this result to an open network consisting of 


a series conrection cf such gueues is immediate. 


Ccnsider a series connection or N queues. For each 


m= 1, 2, ..., N, suppose that queue i has s_ identical 
a) 


exponential servers. Suppose further that jobs enter the 


system ina Fcisson arrival stream at the first gueue and 
depart frem the system in a departure stream from the M-th 
queue after experiencing service at each queue in 
Successicn. Also suppose that the traffic intensity at each 
queue is less than one if the rate of the Poisson arrival 
stream 1s used in each calculation. Burke's results show 
that the input process for each of the N queues is identical 
to the infgut process to the system. Thus, the i-th gueue is 


an aa? gueue with Known interarrival and service 
distributions. The independence proved by Burke indicates 
that the jcint steady-state probability of 2imsliang a. jobs 
memgueve 1 £or i = 1, 2, ..., N is the product over i of the 
steady-state probabilities of finding ae jobs at queue l, 


considered as an individual M/M/s queue. This result was 
i 


Meeeplayed by R. R. P. Jackson [59]. 


Since the superposition cf independent Poisson 


brecesses is a Pcisson process, this result extends easily 
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tc retworks in which several (or all) of the queues 
experience arrivals frcem outside the network. The fact that 
prebabilistic filtering of a Poisson process results ina 
Poisson process facilitates extension to nonserial networks 
so long as there is no feedback. (A queuing network has 
feedback if paths exist which could allow a job to return to 


a gueuve at which it has already received service.) 


Indeed, even feedback can be accommodated, except 
that the rate of the input process to some of the queues is 
net so readily ascertainable. J. R. Jackson [56] considered 
a Cather general open network of N queues in which, for i = 
[cy «oe, N, 


1. Cueuve i has s identical exponential servers. 
at 


2. Jobs from outside the network arrive at queue 


2 in a Pcisson stream with rate r.. 
be 


3. All queuing disciplines are FCFS. 
4. Jobs departing queue i route (instantaneously) 
to queue j with probability p or leave the 
1) 
mrocem with probability 1- (p + p + «ss. + 
11 eZ 


Pin’? 


Noting that the arrival process to any given gueue is the 
Superpositicn cf arrivals from outside the system and 
arrivals frem each of the N queues within the system, 
Jackson defined the average arrival rate of jobs at queue 1 
to be a and stated that in steady-state 


ou. 3) is = Cc. + Dake 


Hewehen proceeded to prove that the joint steady-state 
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Geel iity cr finding n jobs at gueuve i for i= 1, 2, ..., 
1 


feeoetne product over 1 of the steady-state probability of 


memerng 0 jcbs at an M/M/sS | queue With arrival rate R_ and 
at a al 


service rate egual to the service rate at gueve i. This is 


exactly the result given by R. R. P. Jackson, but with the 
arrival rates determined by solving the system of linear 


equations (1.9). Note that, with r = 0 and the sum over j 
St 


of p  eguali to one, Jackson's model is a closed network of 
1J 


gueues. This cffers some hope that a product-form solution 


May also re valid for closed networks. 


Burke proved his results (see the beginning of this 
Suksecticn) under the assumptions of an homogeneous Poisson 
arrival process, identical exponential servers, an infinite 
Capacity and identical jobs. With reference to the 
discussion in the preceding section, it is natural to ask 
questions ccncerning extensions of Burke's results. Fecer 
example, what can be said about the departure process if the 
rate of the arrival process depends upon the number of jobs 
at the queue; or if the rate of service is a more general 
function cf the number of jobs; or if the queue has a finite 
Capacity; or if the interarrival or service times have 
Memerallzed Erlangian distributions; or if arriving jors are 
of different classes, with the arrival process and s¢ervice 
distributions differing with class? Few of these questions 


have peen answered. 


Relch [91] extend2d Burke's work to show that the 
service time distribution must be either exponential or a 
Seeoecruncticn at zero (that is, no service time at ali) if 
both input and output processes are to be Poisson. Finch 
{34] showed that, in order for the departure process tc Le 


independent cf the queue size left by a departing job, the 
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service times must be exponential and the queue cannot have 
finite capacity. Reich also showed that, if the 
interarrival times and service times both have two-stage 
Erlang distributions, the output process of a single server 
queue is not identical to the input process. These results 
hold forth little hope for finding product-form soluticns 
fer networks of gueues incorporating some of the 


generalizaticns discussed in the preceding section. 


However, it must be noted that R. R. B. Jackson, 
being most firecbably unaware of Burke's result which was 
published later than his own, did not use Burke's result. 
Furthermore, although J. R. Jackson acknowledged both 
Burke's paper and Reich's, he used the same solution method 
as did R. R. BP. Jackson. Both authors derived the 
eguilibrium kalance equations in the usual manner (see 
Appendix A), stated the solution and proved that the 


solution satisfied the eguations by simple substitution. 


This same method was used by Koenigsberg [74], who 
Meemone Of the first to exhibit a product-form soluticn for 
a ciosed network of queues, and by Finch [33], whose model 
included a ncnhomogeneous Poisson arrival process. 
Kcenigsberg's model, termed a cyclic queue, consisted cf a 
series of queues in which jobs leaving the last queue 
entered tke first queue. This is a submodel of one of the 
two models ccnsidered by Finch. Finch's models, both cf 
which were cféen networks, inccrporated simple forms of 
feedback. Jcbs arrived at the network in an homogeneous 
Poisson arrival stream, but were turned away whenever the 
network ccntained a specified number of jobs (the capacity 
of the network). In this way Finch used a nonhomogenecus 


Poisson arrival process to maintain a finite state space. 


Gorden and Neweli {46] showed that, because of the 


form of the ncnhomogeneous Poisson arrival process used, 
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Finch's mcdéels are equivalent to closed queuing network 
models ccrtaining one additional queue. This gueue has a 
Single exponential server with service rate egual to the 
rate of the Fcisson arrival process of the equivalent cpen 
model. At any instant the number of jops at this auxiliary 
guéeue may be determined by subtracting the number of jobs in 
the remainder of the network from the network capacity. 
Thus, when the network is at capacity, there are no joks in 
the auxiliary gueue and there can be no "arrivals." On the 
Other hand, when the network is below capacity, there is a 
job in service at the auxiliary gueue and "arrivals" occur 


at the afprorriate rate. 


In this same paper Gordon and Newell went on tc 
consider an arbitrary closed network of M queues with N 
Mueeted! jJOtS circulating in it. For each 1 = 1, 2, «se., 


M, queue i is assumed to have an arbitrary number, r, of 
ah 


identical exfenential servers. Indeed, their model is 


exactly the model of J. R. Jackson discussed earlier with 
exogenous arrival rates all set equai to zero and with the 


Sum over j cf ~f . equal to one. After deriving the balance 
aL 
equations, they assumed a product-form solution and proved 


Maaestne joint steady-state probability of finding n_ jobs 
a 


Meeegucue i for i= 1, 2, ...-, M is given by 
M 
24) n- 
(1.10) 2 (Rat Soe Sac) eee La er eee 
: My al as 
1=1 
meen + nh +... tn = = Q 


N, and Se eo) 


71 
Otherwise. In (1.10) G (N) is a normalizing constant 
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which depends upon the number of jobs in the network, 


IA 
| 


i, oH shame 
(1.11) Se — 
ae: 


iV 
Le | 


| lt 


emmees iS prcportional to the probability of finding a job 
i 
in queue i in the special case that N = 1. The x. can be 
i 


found by solving the (usually much smaller) system of 


equations: 


= 


(1.12) mx = 


where m is the rate of service for a single server at queue 
1 


mead p is the probability that a job leaving queue j will 
shal 


next enter queue il. 


Gordcn and Newell's model is a special case of a 
very general model considered in an earlier work by J. @. 
Jackson {58], of which Gordon and Newell were apparently 
unaware. Jackson's new model consisted of an arpitrary 
network of queues similar to that considered in his earlier 
work (in {56}) discussed earlier in this section. Unlike 
his earlier model, however, tnis new model assumed jobs 
entered the network in a Poisson arrival stream whose rate 
depended upcn the total number of jobs in the network. Tae 
choice of queue at which to enter was made in a Markovian 
Prime asaccOLtding to a fixed probability distribution. 


Service at the queues was exponential with a rate which 


op. 





depended not cnly on the queue, but also on the number of 


joks at the queue. 


in addition, Jackson incorporated two mechanisms, a 
"triggered arrival" mechanism and a "service deletion" 
mechanism. The triggered arrival mechanism provided fcr a 
lower bound on the total number of jobs in the network. 
When the number of jobs in the network equaled this lower 
beund, a departing job was immediately reinserted into the 


network as a newly arriving job. 


The service deletion mechanism provided for finite 
capacity at individual queues. This was accomplished Ly 
automatically ejecting the job in service at a queue 
whenever a new job arrived and found the gueue at capacity. 
Thus ejected, the job proceeded to another queue or left the 
network as though it had just completed its service. As 
pcinted cut in subSection 4.4 of this chavter, this is 
equivalent tc a job bypassing any gueue at Capacity that it 


enccunters. 


Jackscn showed in [58] that the balance equaticns 
for the steady-state fpropabilities have a product-fornm 
sclution. Like Gordon and Newell, he showed that the 
factors of this prceduct-form solution can be determined by 
solving a considerably smaller set or linear equations. 
However, because of the generality of the model, Jackscn's 
solution rfrocéedure is more difficult to apply than the 
Sitilar procedure described by Gordon and Newell. For this 
reason it is Gordon and Newell's model, rather than 


Jackson's, which has been widely examined and applied. 
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Spencer and Sheng [103] have reported using 
Jackson's earlier model in a study of multiprogranmed 
time-sharing computer systems. Avi-Itzhak and Heyman [2], 
Buzen [17], Chiu, Durment and Wood {25] and Kaneko (621 have 
used the results in Gordon and Newell's paper [46] to 
investigate various asrects of a multiprogrammed computer 
system. Torbett [105] used Gordon and Newell's result in an 
Sxeamanaticn cf optimal control of closed quéuing networks 


With adjustarle service rates. 


Gaver [38] modelled a multiprogrammed computer 
system as a closed central server network of single server 
queues aS depicted in Figure 1.1. H2 then showed that, for 


this model, Gcrdon and Newell's result (1.10) reduces to 


4 

— ns: 

fe 13 ale. Files eieuiey 1 = G N x ! 

( ) ( (aoe ’ ee (N) et A 

1=1 
meee FOr €ach i = 1, 2, e«e, UA, 

(1.14) xX. = 4g be /, Ws 
an M+71 1 2 


where m is the exponential service rate at Q and _f is as 
al at i 


Mae igure 1.1. He then used this formulaticn to derive 


G (N) and several measures of System performance, such as 


the idleness probability for each of the gueues. The 
solution given py (1.13) will be used in later chapters for 


Ccpariscn with nuaerical results using the methodology 
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developed in Chapter II. 


Mimerineci pie, the value of G{N) in (1.10) can ke 
determined by appealing to the normality condition, which 
Says that the sum of steady-state probabilities is unity. 


That is, once x has been determined from (1.12), 
; m 


eee (8 ee - ) can be calculated (see (1.10)) for each 


State. These quantities are then added over all states to 


yield G(N). Unfcrtunately, as N and M become large, tne 
total number of states becomes large combinatorially. This 
Memees the use of digital computers. Special pains must be 
taken to see that too much 1s nct lost due to round off. 


This problem is discussed in Dorn and McCracken [29 1. 


Euzen [18] studied Gordon and Neweli's product-forn 
result fcr clcsed gueuing networks and developed an 


megorithm cor determining G(N) uSing the x 's from (1.12). 
1 


Intermediate results are G(1), G(2), «++, G(N-1). He then 
went on to display composite measures, such as the marginal 
Beestributicns, ae “CP aieeterms Or’ G(t) » Gi{Z), «2«., GN). 
This algcrithm sclved some of the computaticnal problems 
facing thcse who wish to use Gordon and Newell's results. A 


gocd review of this algorithm and several extensions have 


been giver cy Bhandiwad and Williams ( 11}. 
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In the same year that Gordon and Newell's much-cited 


WOCK [46] was publisned, P. Whittle { 109] presented tne sane 
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results at the thirty-sixth session of the International 
Statistical Institute. The next year an article by Whittle 
{110] was published in which he displayed a product-forn 
solution for open gueuing networks, reproducing the results 
of Jackscn [58] (of which he, too, was apparently unaware). 
While Jackscn's work was remarkable for its generality, and 
Gordon and Newell's for its simplicity, the impact of 
Whittle's work has been the introduction of the concert of 


ce, also referred to as individual balance and 


The ~-alance equations considered in earlier works 
(hereafter referred to as global balance equations tc 
differentiate them from the local balance equations) eguate 
the weighted rate or flow from a given state to the weighted 
rate of flow into that state. The weights are merely the 
steady-state probabilities of finding the system in the 
appropriate state. For example, the global balance 
eguations shcwn by Gordon and Newell to have (1.10) as their 


Eeiution are 


M 
or. 15) { 3 eeRa(cherr j\ekeue) uP (0 4 soe, 0. } 
alee | 2 AG6 . Sak 1 M 


1=1 


Mf M 


Pee (tinin t1,r jn p. } 
5 see: aie lg | 
1=1 j=1 


XP(N ,eoey,N Tyee e,N t1y..-,0 ) 
1 1 M 


J 


Maere M is the rate of the exponential service times at 
st 


Gueue i, r is the number of servers at gueve i, and p_ is 
a: ij 
the probarility that a job ccmpleting service at queue i 


Melienext route to queue j. 


Sp, 





The local balance equations equate the weighted rate 
(same wiegkts) of flow from a state due to departure from a 
given queue to the weighted rate of flow into the state due 
to an arrival at the same queue. The local balance 


equations ccrresponding to (1.15) are 


(1.16) ° Min(@ 7o )m Pin ,--.,8 ) = 
2 oe ee 1 M 


= 


2 {min(n +1,r )m pj} 
j 3, 


aL 
j=1 


XP (n peee VD 0 Rae ¢ ice rary aay ) 
1 as a 


memeeacn 1 = 1, 2, .--, M Such that n # Q. 
1 


sumgamg (1.16) over 1 yields (1.15). That is, if a 
candidate sclution satisfies the local balance equations, it 
alsc satisfies the global balance equations. Whittle showed 
that a given product form is the solution to the approjriate 
Set of gloral balance equations by showing that it is tne 
solution tc the corresponding set of local balance 
equations. This same technique has been used by several 
authors since to prove that a product form sclution exists 


for a variety of netwcerk problems. 


Sciorning and extending the results of several 
papers, Baskett, Chandy, Muntz and Palacios {6] considered a 
general gueuing network as is now described. The number of 
Gueues 1s arbitrary, but finite. There are an arbitrary, 
but finite, number of job types. The probability that a job 
of type r ccmpleting service at queue 1 will next enter 
mee) d= a jOD Cir type s is fixed. The system may be 
either ofen cr closed. If open, arrivals to the network 


occur in a Pcisson arrival stream with rate dependent upon 
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m@eectoOtal numker of jorks in the system, or in a collection 
of Poisscn arrival streams, one for each ergodic subchain of 
the Markcvian switching matrix, with the rate of each strean 
dependent upcn the number of jobs in the corresponding 
subchain. An arrival enters the system at a given gueue as 
a given type job with fixed probability. Each gueue is one 
Seeecne £Cclicwing four types: 

Type 1: A FCFS gueue with exponential service 

having rate dependent upon the number of jobs in 

the queue, but not their types. 

Types 2: A single server PS queue with generalized 

Erlangian service, dependent upon job type. 

Type 3: An IS queue with generalized Erlangian 

service, dependent upon job type. 

Type 4: A Single server LCFSPR gueue with 


generalized Erlangian service, dependent upon job 


type. 


Using the local baiance technique of Whittle, 
Baskett, et. al. showed the steady-state solution to have 


mie Product fcr: 


M 
(1.17) PCmom(om 7a) w= ¢€ a{S) Tf £.(r-) 
ak 4 vic be eye 

1= 


where M is the numker of gueuves, a is a vector whose 
1 


contents and structure depend upon the type of queue i, c is 


a normalization constant, 4(S) 18S a constant which depends 
upon the form of the arrival process (d(S) = 1 if tne systen 


is closed), and each £ (gn _) is a product whose form defends 
ies 


upon the type of queue ias weli as the contents of n. 
aL 
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Chandy, Keller and Browne [22] have reported the 
development cf a computer program, referred to as ASQ (for 
Ntalgebraic scluticn for gueues"), which provides both 
numerical and algebraic solutions to many types of queuing 
network mcdels. The models which are amenable to analysis 
using ASQ are submodels of the general model of Baskett, 
Chandy, Muntz and Palacios. Recently Reiser [92] has 
reported the development of an interactive computer prograag, 
referred to as QNET4, which provides numerical solution to a 


Slightly breader class of models. 


Ccmputation simpiifying technigues and algorithms, 
some of which are extensions of Buzen's work [18], have been 
proposed for many of the product form soluticns proved by 
Baskett, et. al. Some of these proposals have come frem 
Bhandiwad and Williams [11,112], Hine and Pitzwater [52] and 
Memeer and Kcbrayashi [95,90]. 


A comprehensive treatment of lccal balance has been 
given by Kingman [66], who also discusses a stronger 
property called reversibility. A Markovian queuing network 
1s said tc ke reversibile if the (unconditional) rate of 
transiticn frem a state © to any other state Dis equal to 
M@emrate cf transition from D toc. Letting q(C,D) be the 
Meat tional rate of transition from C to D, and letting p(c) 
be the steady-state propability associated with state C, the 


reversibility ccndition is 


(1.18) FIC)G(C,D) = p(l)g(dD,°C) 


for each fair of states C and D. Reviewing the definition 
Of local Ltalance, it is evident that every reversible systen 
Satisfies the conditions of local baiance. Kingman prcved 
Samat a preduct form solution exists for each irreducible 


reversible system. 


62 





It is easily seen that local balance is not 
eguivalent to reversibility. The tandem queuing models of 
R. R. P. Jackson [59], which are discussed in subsection 
5.1, are examples of irreversible systems which satisfy the 
M@emaations cf local balance. Thus, the work of Whittle and 
others cited above show that reducibility, though 
suffictent, 1S not necessary for the existence of a preduct- 


morn soluticn. 


The wide use of the local-balance technigue for 
Meoving a prcduct-form solution, and the lack of proofs 
based on weaker criteria, lead naturally to a conjecture 
that local balance is necessary and sufficient for existence 
of a product-form solution. However, neither necessity nor 


sufficiency has been proved. 


Very recently Kelly [64] proved the existence cf a 
product-form solution for an open network of gueues with 
Multiple jcb types using a property he terms 
qguasi-reversibility. Supposing a Poisson arrival process 
and classification of departing jobs into groups according 
tc the jck's experience in the network (for example, its 
Service time), Kelly defined a network to be 
quasi-reversifle if departures of the different groups of 
jors form independent Poisson processes and if the state of 
the network at any time is independent of departures uf to 
Meat time. Although quasi~reversibility implies 
reversibility, the relationship between quasi-reversibility 


and local cralance is unknown. 


Defining the conditional rate of departure freer 


Meeace C, g(C), by : 
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(1.179) g(C) = 2 g(C,D) 
D#C 


Kelly proved (see Lemma 1 of [64]}) that: 
If there is a set of positive numbers {p(C)} 
adding to unity, and a set of nonnegative numbers 
{g'(C,D)} such that 


(1.20) g(C) = 3 q* {C,D) 
D#C 
and 
i. 2 1) F(C)g(C,D) = p(D)qg't (D,C) 


mMoid for all states C and D, then {p(C)} is the 

steady-state distribution which satisfies the 

global balance eyguations for the system. 
He then ccnsidered several open queuing network models in 
which an entering job was classified by type according to 
the route (finite and fixed as opposed to the Markovian 
branching prcbabilities discussed by other authors) it would 
take through the network and, in some cases, the service 
distribution it would experience at each queue it visited. 
In €ach model he then established the existence of a 
prcduct-fcrm solution by developing the giokal balance 
equations, guessing values for p(C) and q'(C,D), proving 
met) (1.20) and (1.21) are satisfied, and appealing tc the 
lemma summarized above. The values guessed for p(C) and 
g'(C,D) were made more natural by the relationship between 
reversibility and guasi-reversibpility. No further details 
Will be given here. The interested reader is urged to read 


Kelly's very interesting paper {64}. 


Nct cnly is the relationship between local balance 
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mmomguasi-reversibility not clear, but alsc the 
applicability cf the local-balance technique to Kelly's 
mcdels, and the applicability of Kelly's quasi-reversibility 
technigues tc models whose product~form solution have keen 
preved using the locai-balance technigue are not clear. For 
example, it is not known whether the qguasi-reversibility 
technigues are applicable to closed gueuing networks. The 
models ccnsidered in this thesis are more easily related to 
the models of Whittle and Baskett, Chandy, Muntz and 


Palacios than those of Kelly. 


In searching for a product-form solution based ufon 
local balance, the form of the local balance equaticns often 
Suggests the form or the solution. For example, since the 


Sum over j of the p is equal to unity in the closed model 
1) A 


of Gordon and Newell discussed above, dividing the right 


Side of (1.16) by the left-hand side suggests that 


or. 22) E(t let, . cull — Ip2s~,N ) 
1 5) sh M 
ieee Pp) | 7 [minin +1,5 )m p. 

ls ape Dg 5 ne 


Lo ae 6 ee 
1 M 


Assuming a freduct form such as 


Moon. 
23 ree) | = ” 
( ) ( 1’ 4) ile Ct Y.,? 
i=1 k=1 
léads to the following reiationship 
ei. 24) pin{n +1,cr )p y. = min(n,,C,)m py, 
J pas2 Jy +4 eee eee ets) ty Th | 
5) ae 
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"Factoring out" the dependence of y upon n_ by letting 
2 


fr. 295) ion = UR ner) yy 
at a oe 
i. 


results in 


(1.26) eee, MD ee 
3 j+ J 2 ijl 


ciemeng (1.26) over j ylelds (1.12). The result (1.10) of 


memecon and Newell*s analysis fcllows directly, since b (n ) 
ae 2 


—— 


inccrporates the relationship given in (1.25). 


However, it is not difficult to devise examples in 
which local Ealance does not hold. For example, Sauer and 
mernaay {99 ] consider a closed network consisting of twe FCFS 
Gueues, each having a Single exponential server. Two fobs 
Circulate in the network. The lack of local balance is a 
result of the fact that the two jobs have different service 


rates at cne cf the gueues. 


Since product form solutions seem to be closely 
related to iccal palance, attempts to determine steady-state 
Sciutions fcr networks which do not satisfy the local- 
balance ccnditions either have been numerical in nature or 
have invclved approximation by models which do satisfy tke 
local-balance conditions. A brief summary cf such effcrts 


1¢ given in the next subsection. 
9-4. Numerical and Approximation Methods 


= ee OS ae ae ee SS = = = ab a> we ae Se ea —S a ce 


Based cn Norton's theorem in electrical circuit 





theory, Chandy, Herzog and Woo [20] developed a technigue 
for examination of networks of queues in steady-state. This 
technigue, which is particularly suited to examination of 
the behavior cf a subsystem as itS parameters are varied, is 
best explained in terms of an example. So, consider Figure 
1.8. For simplicity suppose that N jobs of a single tyfe 
circulate amcng the queues, that each queue has a single 
FCFS expcnential server, and that the choice of routing to 
coe 2. Or oF is done ina Markovian manner according tc a 
fixed prckakility distribution. That is, suppose that the 


steady-state probability distribution could be determined 
using the werk of Gordon and Newell (46]. Further, suppose 
that the (marginal) performance of the parallel subsystem of 
gueues, Ecunded by points A and EB in Figure 1.8, is of 


particular interest. 


The first step in examining this system is to "short 
out" the subsystem as depicted in Figure 1.9. (This is 
equivalent tc replacing the subsystem by a queue with zero 
Service time.) Next, for each n = 1, 2, «.-«., N, the 
"shorted" system of Figure 1.9 is solved to determine the 
Bee T{n) at which jods pass through the short (from A to B) 
when there are n joks in the systen. (For this example the 
WOLK of Kcenigsberg [74], discussed in subsection 5.1, is 
Meeeetcable.) Finally, returning to Figure 1.8, the portion 
of the original network exterior to the subsystem of 


interest is replaced by a single composite queue, Q , having 
‘@ 


a State dependent service rate T(n). The analogue of 
Norton's thecrem states that the behavior of the subsysten 
in the resulting simplified system (Figure 1.10) is the same 


as its behavior in the original system (Figure 1.8). 


Note that this technigue reduces the analysis cf a 


rather large, ccmplex system to the analysis of N + 1 
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smaller, simpler systems. Also, note that the state 


dependent sérvice rates, T(n), of the composite queue, Q , 
Cc 
are not affected by changes in the values of parameters 


Within the subsystem. Thus, analysis of the sensitivity of 
the behavior cf the subsystem to changes in the service 


rates at Ce oy, and oF and changes in the routing 
protabilities can Ee accomplished through multiple solution 


of the central-Server system, Figure 1.10, rather than the 


entire complex system, Figure 1.8. 


Also in {20] Chandy, et. al. show that similar 
analogues to Norton's theorem hold exactly for tne networks 
Memeparskett, et. al. [6], which satisfy the local<-balance 
conditions. In an accompanying paper [21], they discuss an 
iterative algcrithm, based upon these analogues of Norton's 
thecrem, for arriving at approximate solutions to netwecrk 
MeeritensS which do not satisfy the local-balance conditions. 
it 1s apparent from the examples in this paper that setting 
of tolerance limits for use in the algorithm to ensure a 
given degree of accuracy in the finai soluticn may be a 
Gifficuit prckliem. The same tolerance limits yield 
different degrees of accuracy in different problems. A 
refinement of this approximate analysis technique is 
discussed by Sauer and Chandy [98], who concentrate on 


céntral-server models. 


In tké mid-1960's Wallace and Rosenberg {108} 
Céported cn SCA (for recursive gueue analyzer), a computer 
program designed to numerically solve the balance equations 
resulting frem Markovian gueuing networks. The relaticnship 
between the procedures used in ROA and the frocedures 
presented in this thesis is discussed in Chapter III. In 
(1C8] Wallace and Rosenberg admit that representation cf a 


model in the form of a matrix which can be used by RQA is 
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tedious. However, a more recent paper by Irani and Wallace 
[55] describes an effort to design another program capable 
of translating a graphical deScription of a network of 
queues into a form which can be used by RQA, thus relieving 
this tedium. The author has not seen a final report on this 
effort, and it is not clear from [55] that such a program 
Meee existence at the time the paper was written. Use of 
RQA has been reported by Smith [102] and Wallace and Mason 
[107]. Lavenberg [75] has reported using a computational 


method sisilar to that used in RQA. 


This ccmpletes the literature review. Attenticn is 
now drawn to sclution of some of the computational protrlems 
encountered in using the Markov chain approach on netwcrks 


of queues. This is the subject of Canapter II. 
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This chapter addresses the computational problems which 
arise when a network of gueues is modelled as a Markov 
Chain. As nected in Chapter I, scme important work aas been 
dcne in cases in which local balance nolds and a product- 
form soluticn results. The emphasis in the current chapter, 
and throughout the thesis, is on those cases in which local 


balance dces not hcld. 


In the first section the basic model is introduced. 
This model is a closed central-server model with no 
immediate feedback. (That is, jobs leaving a processor must 
precede to a different processor.) Although many of the 
techniques discussed nere are applicable to more general 
models, this kasic model serves as a focal point and i1§ not 


meweld OL useful application. 


The first problem facing anyone who develops a Markcv 
Chain mcdéel is the definition of a state description which 
contains the information necessary to fully describe each 
State and differentiate between states. This is the subject 
of the second section. The vector representations presented 
there are sifilar to those found in many references, fcr 
example, Easxett, Chandy, Muntz and Palacios [6]. However, 
the attempt of the author to present computational 
procedures which are easily adaptable to codes for use on 
high-speed digital computers has resulted in a more explicit 
definiticn cf the representations than is often found in the 


Open literature. 


Once a representation for the states has been chosen, 


Ue 





attention turns to development of the equaticns of 
statistical equilibrium, 1. e., the balance equations. 

(Note that the concern bere is the long-term average 
results, i. e., the so-called "steady-state" results.) This 
attention results in several computational problems, namely, 
how to generate these equations, how to store them, and 
finally, how to solve them. The first two of these 
questions are the subject of section 4. The final question 


1s discussed in the next chapter. 


It is generally inefficient (not to mention tedious) to 
refer to the states by their vector representations when 
stcring and solving tne balance equation. It therefore 
becomes useful to sequence the states so that they may be 
referred to ty sequence number. In section 3 the 
lexicographic sequencing procedure (so called because cf its 
Similarity tc the alphabetical sequencing of words in a 
dictionary, cr lexicon) is described and applied to the 
vectors representing the states. Also in this section is 
found explicit discussion of two related, and quite 
difficult, problems: storage of the vector representations 
of the states, and determination of the sequence numper of a 


State from its vector representation. 


The final section of this chapter contains a discussion 
of the preperties of the system of balance equations. [In 
particular, scme of the properties which are important in 


Choosing a solution method are pointed out and discussed. 


Most or the concepts and computational procedures 
introduced in this chapter are first presented in the 
context of a particular case of the basic model. This case 
1s introduced in subsection 1.1 and is called the "xev 
example" thrcughout the thesis. A wide variety of 
géneralizaticns of the key example are discussed in 
mamsecticns 1.2, 2.2-2.7, 3.3-3.9 and 4.2-4.7. These 


74 





subsecticns nay be omitted on a first readinc to relieve 


some of the tedium which otherwise results rather naturally. 
feeeias EASIC MODEL 


The basic model of interest in this chapter is what has 
been called by many authors a central-server model. As 
indicated in Figure 1.1 this model is a closed network of 
gueues ccnsisting of a central server, hereafter called the 
CPU (central processing unit), and M peripheral processors 
(hereafter called the BP's), labeled PP1, PP2, ... , PEM. 
Any job, or customer, completing service at cne of the PP'ts 
1s routed directly to the CPU. Any job completing service 
at the CPU is routed directly to one of the PP's. The 
choice of PP in this latter case depends upon a probability 


distribution {p } and is independent of previous choices. 
ai 
The individual frobabilities in this distribution are termed 


branching prckabilities. 


Being a closed network, the number of jobs circulating 
amcng the M+1 processors is fixed. We will use N to denote 


fois Rumcrer. 


As indicated Ly the terminology used here, the author is 
interested in models which are approximations of computer 
Systems. This should not detract from the fact that the 
concepts and téechnigues discussed in these pages are 
developed for networks of queues and not just models of 
ccmfuter systems. Many other systems could Ee modeled as 


queuing networks, some even as central-server aodels. 


mieweclosed Central~server models discussed in this 


Chapter are, at best, approximations of computer systems. 
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This is mest cbvious from the fact that the number of jobs 
is fixed. However, as discussed by Gordon and Newell [46] 
and others, many open queuing networks can te reformulated 
as closed networks. Also, the central-server model can be 
used as a sukmodel in a model which allows the number and 


Compositicn cf jobs in the system to vary. 


The model described above is very general. For example, 
as indicated in subsection 2.3, multiple (identical) CEU's 
can be mcdeled as a single multiserver CPU. Most of the 
techniques discussed are applicable to more general gueuing 
networks, as hinted at in subsection 1.2. Scme of the 
reasons for considering closed central-server nodels are 


given at the end of section 5. 


Throughout this chapter a particular example is used to 
introduce and illustrate the various concepts and 
technigues. The generality of these concepts and techniques 
are then discussed in terms of generalizations of this key 


example. 


1.1. Th 


im 


Key Exagpile 


Fer the key example all service times are 
exponentially distributed and all queuing disciplines are 


fers. iIwc types of jobs, of type one and Vacate v o£ 
vb: 


type two, circulate in the system. The service rate 


(Ceciprocal cf mean service time) at each gueue and the 
Dranching prckabilities depend upon job type. RATz#(I,J) 
denotes the service rate of a type-I job (I = 1,2) at 
precessor J (J = 1,2,...,4+1), where processor J is the CPU 
1f£ J = M+1 and PPJ if J < M+1. ALFA(I,J) denotes the 
Prcebadiliity that a type-I job (I = 1,2) routes to PPJ (J = 


1,2,...,M4) after completion of service at the CPU. Each 





queue has oniy one server. 


The key example as described here is the model 
discussed by Gaver and Humfeld [39]. The development 
presented here is similar to that used in [39], although no 


generalizaticns are discussed there. 


Peet his point generalization of the number of job 


Mees 15 Obvicus. If K is the number of job types, let N 
K 


be the number of type-k jobs in the system for k = 1, 2, 
Meee nk and make the restriction that MY + SS +? Pear Ne = NS 
K 
Dienrate Gatrix RATE(I,J) and the branching probability 
matrix ALFA(I,J) would be expanded to allow I to become as 


Marge as kK. 


Generalization of the service distributions to 
include generalized Erlangian distributions would involve 
addition cf another dimension to the rate matrix to indicate 
Stage of service. For example, we might use RATE(I,J,L) to 
denote the rate parameter associated with the L-th stage of 
Service for type-I jobs at the J-th processor. In addition 
it would be necessary to provide another matrix to indicates 
Smee probability of completing service at the processor with 


completicn at each stage of service. 


Nete that the form of the network itself nay also be 
generalized. By adding another dimension te the brancaing 
prebability matrix, consideration may be given to the most 
general type of queuing network. For example, 
ALFA(I,J,1,J') might be used to denote the probability of a 


Mepe-i jok rcuting to processor J after completing the L-th 


Pra 





stage of service at processor J'. 


Other generalizations will be discussed in the 


following sections. 


fees DALE DESCRIPTIONS 


Note that the structure of the key example involves 
Markov-like assumptions. In particular, service times are 
exponentially distributed (memoryless) and choice of PE to 
route to, fcllowing service at the CPU, is independent of 
cheices that may have teen made earlier. Indeed, it is 
exactly thesé assumptions which allow the construction of 
the balance equations and the solution for steady state, 


both in the key example and in numerous generalizations. 


Nonetheless, sc long as there is at least one procéssor 
Bomwhich jobs ci more than one type can route, at which 
different types cf jobs receive service at different rates, 
and which has a FCFS queuing discipline, a simple 
compilaticn cf numbers of jobs present at each processor 
does not define a Markov process. Even an extension tc 
Specify tke number of jobs of each type present at eaca 


prccessor will not define a Markov process. 


To see that this 1s true, consider the Key example in 
which the CEU is a processor of the type described in the 
preceding paragraph. The probability of leaving a state in 
the time interval (t,t+dt), given that the system 1s in that 
state at time t (a guantity needed in development of the 
Kolmogorcv differential equations and subsequently the 
Dalance eguaticns), is egual to a sum of terms one of which 
Mem pcOpOrtional to service rate at the CPU for the 


Meet rcular jich type in service there. Thus, 1t 1S necessary 
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to know which type of job is in service. Further reflection 
concerning what needs to be known in order to develop the 
Kolmogorov differential equations and the balance equations 
reveals that the order in which the types of jobs arrived at 
the CPU, cr equivalently the order in which the types of 
joks currently at the CPU will receive service there, gust 


be known. 


Fer the present assume that ALFA(I,J) is positive 
Meee = 1,2 and J = 1, 2, ..., M4. That is, assume that any 
jok can visit any given processor in the course of its 
travels. Then as discussed above, to specify a state it is 
necessary to specify the order of job types at each 
precessor. Towards this end consider a state vector of 
length N + M. The first N components of the state vector 


consist of scme arrangement of "ones" and ue towos!! 
representing the N typeée-one jobs and ae EY PE=twWO  JObS Li 

1 
the system. For J = 1, 2, ..., M component N + J enumerates 


the jobs at FFJ. Hereafter this vector representaticn is 
Mempmed TSTATE. Now suppose that for each J = 1, 2, «sey GA, 
ISTATE(N+J) = L . Then the following conventions are 

J 


fcllowed: 
(1) The first oe components of ISTATE represent 
the jobs at PP1l, the next Be components represent 
mace, FODS at FEZ, ..., the next = components 
represent the jobs at PPM, and the remaining 


compcnents (of the first N) represent the jobs ai 
the CPU. 
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(11) The components of ISTATE representing jobs at 
a given processor are listed in the reverse of 
their order of arrival (the line forms to the 
left), and hence, in the reverse of their order of 
service at that processor. In particular, the 
rightmost ccmponent 1s the type of job in service 


at that proceSSor. 


Example z.1 


Let = 3, ue = 4 and M= 2. Then N = 7 and ISTATE 
must have length N + M = 9. Consider ISTATE = 
mente, 1,2,2,1,3,2}.Note that there are oe = 3 70DS at PPig 
“ sez 3C0CDS at PP2 and N - oy = ee = 2 jobs at the CPU. 
This 1s emphasized in the following diagrammatic 


representaticn of this state vector. 


Jobs_at_PPi__ jobs at PP2___jops at CPy___L___t, 
1 3 2 


ho 
— 
NO 
wos 
No 
ho 


At PP1l a type-two job 1S in Service, a type-one job will 
enter service next, anda type-two job will enter Service 
after these cthers have completed service. At PP2 a type~<two 
Job is in service followed by a type-one job. At the CPU a 


type-one jok is in service roilowed by a type-two. jcb 


Example 2.2 


Let . = 3, i = 4, M = 3 and ISTATE = 
Mey 2, \e2,2,1,0,0,03}. This is represented diagrammatically 


Dy: 
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lc We 2, ly | 0 0 C 


All jobs are at the CPU. A type=one job is in service. The 
next six jobs to enter service at the CPU will be of types 


two, two, one, two, one and two respectively. 


Example 2.3 


SUFEOSE _ =3, . = i andene—- 3.0 oUppOse further 
that it is observed that there are two type-two jobs at PP2, 


twce type-cne jonos at PP4Y, and all other PP's are idle. fThen 
the ISTATE vector representation of the current state cf the 
system is 

Meee = {2,27 1,1,2,2¢ 1¢0,220,2,9} 1£ a type-one 

job is in service at the CPU; 

meen = {2,2,1,1,2,1,2,90,2,0,2,0} if the type-one 

job will enter service at the CPU after the 

current job completes service there; or 

fee — (2,2, 1,171,2,2,0,2,0,2,0} if the type-one 

jobd will enter service at the CPU only after both 

other jcbs there have completed service. 


Digrammatically, these three states may be represented as 


fcllows: 
Seer re? PPS  _PP4 __PP5____CPU alee a eee 
7T Das ni 5 
Zee 2 4 ae 2, 0 Z 0 2 0 
Ce et a ee 0 2 0 2 0 
Lg Z 1 gv 71 1 w 2 rj 2 0 2 ¢ 


Mme weOnlskhxample 2,3 1f 1S evident that any state 
of the system can be represented in terms of an ISTATE 
Meesors. ff ALFA(L,J) is positive for I = 1,2 and J = 1, 2 


| 
o--, M, then a different state is represented by each ISTATE 
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vector satisfying the following rules: 
mabe 13 The length of ISTATE is N + M. 
Rule 2: The first N components of ISTATE consist 


of by cnes and b twos in some order. 


Rule 3; Each of the last M components of ISTATE 
is a non-negative integer. The sum of these M 


integers is no larger than N. 


If ALPA(I,J) = 0 for some I and J, scme of the 
ISTATE vectors satisfying these three rules will not 
correspond tc feasible states. For example, if ALFA(i,1) = 
0, any ISTATE vector which has Ey = ISTATE(N+1) > O and 


Which has a cneé among the first is components corresponds to 


an infeasible state. Such cases may be handled in a number 
of ways, scme of which will be discussed in the coming 


sections. 


ee ee me ee > ce ee —_= Si a a a = —— a= 


2.2. Generalization of Number of Job Types 


If there are K jon types and i” Jobs of type K fcr k 


Bu 2, ~---, K, then ali of the above applies with Rule 2 
modified to read: 
moe 2; The first N components of ISTATE consist 


Gian ones, N twes, ..., and N "K"s in some 
1 Z K 


order. 


2.3. Generalizaticn of Numper of Servers 


Consider a modél Similar to the key example to model 
a system with L identical CPUS but with a single waiting 


Mee, SO that if more than L jobs are at the CPUs, the first 
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jok engqueued will ke serviced at the first available CFU. 
Then the CPU cculd be modeled as a multiserver queue. The 
information necessary to specify a state is tne same as that 
required for the key example except that rather than the 
order of jobs in service at the CPU we need know only the 


number ot jobs of each type in service. 


Keeping Enis LRemilnad, toe LSTATE vector could tke 
reformulated to inciude the number of jobs at each PP (M 
components), the number of each type cf job in service at 
the CPU (K ccmponents if there are K job types) and, in 
appropriate crder, job types for those jobs at the PP's and 
these jorEs engueued at the CPU. Because the number of jobs 
engueued at the CPU varies from state to state, ISTATE will 
have variable length when formulated in this manner. 
Ccomputaticnally (in FORTRAN, for example) ISTATE must have 
dimension large enough to accomodate the largest possitle 
length. This largest length is easily seen to be N + M+ K 
(cealized whenever there are no jobs at the CPU). This 
becomes mcre ccmplicated as the number of multiserver 


prccessors increases. 


Ncete, however, that the same formulation for ISTATE 
as was discussed akove for the key example can be retained 
if any information concerning multiservers is retained 
separately ard techniques are developed to computationally 
Meanpale any cesuilting complications. Specifically, these 
complications are due to the nonunigue representation cf 
scme states in terms of the ISTATE vector. The following 


example illustrates this point. 


Example z.4 


Let K = 2, N = 1, N = 7, M = 2 and the number of 
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servers at the CPU, L = 2. Then the state with both jcbs at 


the CPU (and therefore both jobs in service at the CPU) is 
Tepresented Ey both ISTATE = {1,2,0,0} and ISTATE = 
{2,1,9,0}. 


The single server processors discussed earlier can 
be considered as a special case of the multiserver 
precessor. However, a more interesting special case is the 
infinite server (IS) queue as introduced in subsection 4.3 
of Chapter I. In the context of closed networks of queues 
where the total number or jobs is limited, the number of 
servers may not be truely infinite. Rather it is 
sufficiently large to simultaneously accomodate all jots 
Which may visit the queue. [In this sense, the CPU is an IS 


gueue in Exagple 2.4. 


D> al eer =e as a eS 


(The queuing disciplines referred tc here are 
discussed in scme detail in the second section of Chapter 
I.) 


Fer all or the disciplines discussed here, the 
structure of the ISTATE vector as originally introduced 
contains all reguired inrormation. Although special 
reformulaticns which contain the required information in a 
more explicit form are possible in most cases, problems 
Similar tc those discussed above for multiserver queues 
arise. As a result the author feels that it is advisakle to 
retain the current structure of the ISTATE vector and handie 


computationally any resulting complications. 


LCFS: The information reguired is exactly the Same 


as that required fcr FrCcFS. However, the enqueued jobs are 
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listed in their crder of arrival rather than the reverse. 
In this way the rightmost job is still the one receiving 
service and the rightmost engueued jop is still the next to 


meceive service when a server is available. 


Ncnpreemptive priority: If, for example, type-one 
jobs have higher priority than type-two jobs at certain 
gueves then the jobs enqueued at those queues must be listed 


so that all cnes are to the right of all twos. 


Preemptive priority: Again, if type-one jobs have 
higher priority than type-two jobs, then all jobs at such 
processors must be listed so that all ones are to the right 
Seeatl twes. 


merSER and LCFSPRpt;: All jobs at such processcrs 
must be listed in the order of their arrival with rightmost 
jok being the most recently arrived job. If the processor 
has a nonexponential service distribution, as discussed 
below, the stage of service stored for engueued joos is the 
Stage the jok was in when interrupted in the LCFSPR case and 
the highest stage attained by the job since last leaving the 
processor in the LCFSPRpt case. Additional components for 
€ach server at each LCFSPRpt processor are required to 


record the current stage of service for each job in service. 
Powmerne Order of the jobs.at such processors is 
immaterial. This will be discussed more fully in the coming 


sections, but the meaning of this statement is clarified in 


the folicwing examrle. 


Example 2.5 


Let K = 2, N = 2, a = 2, M =2 and suppose that the 
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CEU has a PS discipline. Then the following six ISTATE 


vectors represent the same state: 


alee ee 2a, 0} (2 le 2,10 707 
{1,2,1,2,90,0} {2,1,2,1,09,9} 
{1,2,2,1,0, 9} {2,2,1,1,0,0} 

2.5. Generalization of Service Distribution 


Consider modification of the key example to 
incorporate ceneralized Erlangian service distributions for 
Cneé Or more types of jobs at one or more of the processors. 
Then at least for those types of jobs having nonexponeatial 
distributions and at those processors where these 
distributions apply, it will be necessary tc include in any 
State description the stage of Service. (See Example 1.1 in 
Chapter I.) If all precessors have non-preemptive queuing 
disciplines, this may be accomplisned by adding M + 1 
components to the ISTATE vector (assuming each processcr has 
@ Single server and none have a PS gueuing discipline) and 
uSing these te store the stage of service for the job in 
S€qIvice at the M + 1 processors. (Of course, fewer than M + 
1 ccmponents need to be added if one or more processors have 
cniy exponentially distributed service times. Furthermore, 
more than M + 1 components may be required if one or nore 
prccessor has multiple servers or a PS gueuing discifline.) 
If cne or mcre processors has a preemptive service 
distribution, N components should be added to ISTATE tc 
record the stage of service for each of the N jobs in the 
System. This number should not ke reduced for reascns 
Similar tc those discussed under multirfle server queues 


above. 
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Consider the key example with the following change: 
MaeewcPU has a finite capacity, C. That is, if there arec 
jors at the CPU (in service and engueued) and a job 
ccompletes service at one of the PP's, rather than routing to 
the CPU the job stays at the PP blocking other jobs engueued 
there from receiving service. When a job subsequently 
ccmpletes service at the CPU and routes to one of the PP's, 
a job will simultaneously route from one of the blocked PBP*'s 
to the CFU, allowing the next job (if any) engueu2d at that 


PP to begin service. 


Such models can be handled using the technigues 


Hy 


discussed in this tnesis if some procedure is specified fo 
determining which PP will be unblocked by a service 
completicn at the CPU ir more than one PP is blocked. 
Options fcr such procedures include: 

(ee rLACrIity Scheme: e.g., PP1 is unblocked 

bencre PP2, which is in turn unblocked before PP3, 

(12) Probabilistic scheme: e.g., having assigned 


eepiesitive number O to PP1 for i = 1, 2, «oe, UH, 
al 


the protability that PPj is the one unblocked 
Bieven that it iS biocked) 1s equal to Q divided 
Dyeecoe sum Of ~he O 's over all blocked PP's. The 


a 
Q 's are relative priority numbers in that PPi is 
1 
twice as likely to be unblocked as PPj if both are 


Doexed and Q iS twice as iarge as Q . 
1 5 


GemmcmcouvomMmaticn O: (1) and (ii): e.g., first 


PELOrity iS given to the PP to which the job 
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completing service at the CPU routes; if this PP 
monet blocked, each of the blocked PP'ts are 
equally likely to be the first unblocked. 

(iv) FIFO scheme: 1.¢e., the PP which has been 
biocked the longest (or shortest for a LIFO 


scheme) is the one unblocked. 


Whatever the seneme, the model can probabiy be 
memered by addition to ISTATE of an additicnal compenent for 
each PP specifying its blocked/not blocked condition. [In 
the priority and pfrobpabdilistic schemes {and combinations of 
them) this ccmponent can be set equal to one when the EP is 
blecked, and equal to zero otherwise. In a FIFO (or LIFO) 
scheme the value taken on by this component should indicate 
its relative position among the blocked PP's. For examrfle, 
1t may be set equal to zero if the PP is not blocked, one if 
it has been blocked longer than any other blocked PP, two if 


Only one FP has been blocked longer, etc. 


If cne or more of the PP's 1S a multiserver guéue 
and a pricrity or probabilistic scheme is used, the 
blecked/nct blocked component can be used to indicate tha 
Number of servers blocked. In such cases, the order of the 
job types in ISTATE for a multiserver PP should be those 
engqueued followed by those being served foliowed by thcse 
blecked. 


If cone or more of the PP's (rather than the CPU) has 
Finite capacity, a component should be added to ISTATE for 
each server at tne CPU. (The CPU is assumed to not have a 
PS discipline.) In tuis case the component corresponding to 
a given server should tell which PP is causing blockage of 


that server. 


memenemorrmore PP's and tne CPU have finite 


Capacity, care should oe taken that it 1S not possible to 
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deadlock the system by having the CPU blocked waiting for a 
vacancy at scme PP and having that same PP blocked waiting 
merea Vacancy at the CPU. I£ such a state is feasible, it 
is an absorbing state and the resulting steady-state 
conclusicns are predictable. (For more on deadlocking, the 


reader is referred to Havender [{49].) 


Ancther phenomenon which can be handled using the 
technigues discussed in this thesis is bulking. Bulking 
occurs when jobs (fossibly of a given type) are reguired to 
leave a given processor in groups of two or more. For 
exarple, if type-two jops must route from the CPU in groups 
of three, a type-two job completing service there will enter 
a culking queue if no more than one other type-two job is in 
the buiking queue or will route with two other type-twec jobs 
(both from the bulking gueue) to one of the PP's. To handle 
bulking it is, necessary to add one component to ISTATE for 
each processor at which bduiking occurs. This component will 
hold tae number of jobs in the bulking queue for that 
processor. The order of job eypes in ISTATE for a processor 
at which bulking can occur should be (from the left) those 
engueued for service, those being served and those in the 


bulking gueue. 


3. STORAGE AND SEQUENCING OF STATES 


In the next section it will be shown that the ISTATs 
vector form cf state representation lends itself readily to 
generation cf the balance eguations. However, informative 
as this representation is, and as important as it may Le in 


gé€neraticn of the balance equations, there are sone 
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important reasons for sequentially numbering the states; 
i.€., assigning to each state a name, its state number, fron 
among the positive integers so that it may be referred to 


directly withcut reference to a lengthy string of numbers. 


First, when properly sequenced, the states may be 
considered one at a time without fear of inadvertently 
ch@itting cr repeating states. This 1S important since 
several passes through the entire list of states is required 
to generate the balance eyuations, solve them for the 
Steady-state probability distribution, and from this 
distribution calculate the desired measures of systen 


performance. 


Second, storage of the balance eguations is considerably 
mcre efficient if done in terms of the state numbers rather 
than the vectors. Each palance equation involves reference 
to at least two states and, in many cases, more. Consider a 
Falance equation referencing five states in a model in which 
there are seven jobs (N = 7jTand three PP's ({M = 3). The 
State numbers for this balance equation would require five 
stcrage spaces; the state vectors would require fifty. If, 
for example, all processors were modeied as FCFS single 
server queues (the Key example) and the seven jobs were six 
ef one type and one of another, then five is about the 
average number or references for each of the 840 balance 
equations. So the advantage in this case is storage of 


about 420G numkers as compared to 42,000. 


Third, tc solve the balance equations it 1s not 
necessary to know anything about the individual states. All 
that is required is a way of differentiating between the 
States. Sequential numbering of the states provides nct 
Only this capability, but also a convenient way to proceed 
through the kalance equations while computing a soluticn. 


Beat 1S, in a FORTRAN program we will be allowed to use 4a 
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"DG loop.") 


As is evident from the above paragraphs, the balance 
equations shculd be stored in terms of the state numbers. 
However, the information contained in the vector 
representation is required to generate the balance 
eguations. Hence, a procedure is required for efficient 
determinaticn of the state number from its vector 
representation. The problems of sequentially numbering the 
states, storing their vector representations and determining 
the state number from the vector representation are 


interconnected and will be considered simultaneously. 


The techinque which leads to useful seguencing of 
Maem oLATE vectors is constrained lexicographic ordering. 
Fhis technigue has long been used in mathematical analysis 
as a means cf proving that the rational numbers in the 
interval (0,1) are countapbie. It has also been useful in 


enumeraticn algorithms for integer programs. 


Gaewlasic Precedure for constrained lexicographic 
sequencing cf integer vectors is summarized in the following 
steps; 

fm TO get the first vector, start with the 
leftmost component and successively set each 
component equal to the smallest number which will 
yleld a vector satisfying the constraints. 

{1i1) Each successive vector is derived from its 
predecessor by increasing the vaiue of cne of the 
compcnents and successively settlag each component 
to its right eyual to the smallest number whicn 
Will yield a vector satisfying the constraints. 


In each case the component increased 1s the 
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rightmost component which can be increased without 
violating the constraints. The number to which it 
is increased is the smallest number (larger than 
its previous value) which will satisfy the 
constraints. 

A more detailed version of this procedure is presented in 


megorkthm® 1 in Appendix B. 


The constraints referred to here vary from frotlen 
to problem. In gereral, they are equivalent to the 
characteristics cf the vectors to be sequenced. In thé case 
of integer programs, the constraints of the crogram are the 
ones referred to above. The following example shows hcw 
constrained lexicographic sequencing of integer vectors is 
used to frove that the rational numbers in the interval 
(0,1) are countable. In doing so it not only exemplifies 
the use cf the procedure outlined above, but also clearly 
sets forth the constraints and shows their relationshif to 


the character of the vectors sequenced. 


Example 2.6 


In order to prove that there are a countable numter of 
rationals between zero and one, it is necessary to exhibit a 
Mapping frcom the counting numbers onto the set of raticnal 
numbers in ({0,1). (See Halnos, {48].) In cther words, 
these rational numbers must be sequenced so that given any 
particular rational number, r, some counting number, i, may 
be determined such that r is the i-th number in the 
sequence. 

Toward this end recall that a rational number is the 
Mmaeto a/b of two integers. Since the goal is to sequence 
the raticnals in (0,1), a and b may be assumed positive witha 
a< b. Now consider the set of all vectors {b,a} with a anda 


Db positive integers anda< b. Since such a vector can be 


a2 





memnd £LOr each rational number in (0,1), and since each such 
vector can correspond to only one rational number in (0,1), 
the proof is ccmplete if the vectors can be sequenced. [In 
mathematical terms, the mapping which takes {b,a} to ayb is 
a Mapping frcem the set of all positive integer pairs {£,a} 
such that a < b onto the set of rational numbers in (0,1). 
This mapping composed with the mapping of the counting 
nungbers onto the set of such integer pairs (represented by 
the sequencing of these pairs) yields a mapping of the 
counting numbers onto the set of rational numbers in (0,1). 
Exactly how this werks will be clarified after the above 
procedure has been used to sequence the vectors. 

First the constraints must be derived. If {b,a} is a 
"yalid" vector (that is, one of the vectors to be 
sequenced), then a and b are positive integers and a < b. 
Thus, the constraints to be used in the segquenceng procedure 
are; 

Rule 1: a and o are positive integers. 

Rule 23 a< D. 

Now that the constraints have been specified, the 
procedure outlined above can be used to sequence the 
vectors. The first vector is determined using step (i). 
According to this step, the compcenents are determined from 
MeeeetO Light. That is, first b and then a will be 
Getermined. Furthermore, each component will be set equal 
tc its smallest feasible value. By Rule 1 this value is one 
for both a and b. However, Rule 2 restricts b to be larger 
than a. Thus, the smallest value of b which will lead to a 
valid vector is two. The choice for a is necessarily cne 
and the first vector is {2,1}. 

Havang found the first vector, the second, third, 
fourth, and sc forth vectors are determined by successive 
applicaticn cf step (ii). In determining the second vector, 
note that increasing a will violate Rule 2. Thus, let b= 3 
and set a equal to the smailest value which yields a vector 


Satisfyinc the constraints. The second vector is seen to be 
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{3,1}. The value of a can be increased to derive the third 
-vector: {3,2}. Step {ii) is used successively to generate 
the remaining vectors: ice, chee 64,3), {5,13 , {5,2}, 
To determine the seguence number of a particular 

rational number, r, in (0,1), first find positive integers a 
Saaeeo such that r = a/b. Then, r is the i-th rational (nore 
formally, Mmoctamlaured Onto bf) 1f){b,a} 1S the i-th vector. 
For example, if r = .375, xr = 3/8 and r is seen to be the 
24-th rational number according to this sequencing 


procedure. : 


Note that in this example each rational number in 
(0, t) has more than one (in fact, an infinite number) of 
sequence numbers. For example, r = .375 is not only the 
24-th rational, but also the 111-th (r = 6/16) and the 
1977-th (rc = 24/64). 


Cn the other hand, each "valid" vector has a unique 
Seguence number. This fact 1s important in the applications 
of interest in this thesis. In these applications each 
state of a system is denoted by a unique integer vector. 
Using the lexicographic seyuencing procedure outlined above, 
these vectors are sequenced. The sequence numbers are 
called state numbers and are used in storage of the balance 
equations. It is important that each state has only one 
state number, so that inadvertent repetition of states may 


be avoided. 


Cf course, it is also important to avoid inadvertent 
Omission of states. This is done by carefully choosing the 
vectOr representation and the constraints sc that each state 
1s uniquely defined by a vector satisfying the constraints 
and each vector satisrying the constraints describes a 
unigue state. In section 2 the ISTATE vector representation 


waS intreduced for the xey example and a variety of 
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G@eperalizaticns. Rererring to subsection 2.1, the 
constraints to be used in the lexicographic sequencing of 
the ISTATE vectors ror the key example are: 


PoraAte s-quencing Constraints 


Rule 1: The first N components contain N ones 
1 
and E twos. 


Rule 2: The remaining M components are 

nonnegative integers whose sum is no larger than 

N. 
The follcewing example illustrates the application of tne 
lexicographic sequencing procedure to the ISTATE vectors for 


a particular case of the key example. 


Example z.7 


Consider the key example with a = 2, = 2 and M = 


2. The following tabie shows 27 of the 90 states with their 


corresponding state numbers as provided by the lexicographic 
ordering frocedure above applied to the ISTATE vectors. The 


entries in the column labeled NS are the state numbers. 


NS ISTATE NS ISTATE NS ISTATE 
fit, 1,2,2,0,0} emit 2, 2792703 (eo @i,2,1pe-o ses 
mum, 1,2, 2,0, 1 tl een 2, 22,1 DO? 2 8, 1 
Mm, 1,2, 2702 Wie 1122.2, 2,2 sO eee tee 6, 0 
Mi). 1,2,2,0,3 feet 1.2-2.3,0 Sele? 2. 10,0 
fm, 1,2,27004 a eld, 1, 2,2, 3,1 Meweet 2214.0 
mit, 1,2,2,1,0 1S is IAA AAA Momeni 2 (Ae 0- 0 
Mit; 1e2e2e101 Neel 22 172-0; 0 Steel ieee. 8 
Sue 1,2, 2.1.2 Waele 21.2. c-g Tomas oo eG. 0 
Mui, 1,2,2¢173 ome diele, 2, 152,002 SOM 2 ll Os 


Mere that for this example Rule 1 states that the first four 
components must consist of two 1's and two 2's. Rule 2 
States that the sum of the last two components must be no 


targer than four. In setting up the first state vector, the 
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first twc compenents are set equal to one Since by Rule 1 
this is the smallest value these components may take on. 
Rule 1 new forces the third and fourth components to be set 
egual to two. The last two components are both set equal to 
zero, the smallest values they can take on and still satisfy 
Rule 2. In progressing from state to state; the sixth 
component is successively incremented until (state 5) it 
cannot be incremented further without causing violation of 
Rule 2. At this point the fifth component is incremented, 
and the sixth compecnent is set at its smallest feasible 
value. Successive states are determined by again 
incrementing the sixth component. This procedure continues 
until state 15 where further incrementing either of the last 
twe compcnents will cause violation of Rule 2. Incrementing 
either the third or the fourth component will cause 
violation of Rule 1. So, to get state 16, the second 
ccmponent is incremented, the third and fourth ccmponents 
are set at the smallest values allowed by Rule 1 (one and 
two respectively), and the last two components are set at 
the smallest values allowed by Rule 2. From here the 
procedure starts again to increment the last component in 


determining successive states. 


Fer the key example lexicographic seguencing of the 
ISTATE vectors is convenient, and an efficient computational 
scheme can be developed for determining the state number 
frcem the vector representation. For the generalizations 
discussed earlier in this chapter, this same seguencing 
prcecedure could be used if further constraints are impcsed. 
However, cther sequencing procedures are found to be more 
convenient cr more appealing for some of these 
generalizaticns and, at the same time, no iess convenient 
for the key example. furthermore, they allow computational 
analysis cf cne of the solution procedures (see Chapter 
Tift). If the states are arranged according to a 


Mmex2ecographic sequencing of the ISTATE vectors, Similiar 
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analysis is considerably more complicated and remains an 
open proklem (see the conjecture in subsection 4.3 of 
Chapter Iil.) 


These other sequencing procedures aré based on 
lexicographic ordering of vector representations which are 
derived frcem the ISTATE representation. In this subsection 
we will discuss one of these other procedures. A second 
will be discussed after the problem of storage of the states 


has been considered. 


Consider splitting the ISTATE vector representation 
of a state intc two parts. (This will be found to be a 
useful idea when we discuss storage of the states in the 
next subsecticn.) The first N components will be referred 
tc as the left subvector and the last M as the right 
sSukvector. The ISTATEm1 (m1 stands for modification one) 
vector representation of the state is a (row) vector of 
length N + M + 1 whose first component is the sum of the 
components of the right subvector (i.e., the total numter of 
joks at the PP's), whose next M components form the right 
Sukvector, and whose last N components form the left 
subvector. The cecnstraints used in the iexiccgraphic 


ordering procedure for these vectors are: 


ESTATEmM!] Sequencing Constraints 
Rule 1: The first component is a nonnegative 
integer nce larger than N. 
Rule 2: The next M components are nonnegative 
intecers whose sum is the first component. 


Rule 3: The last N components consist of sp ones 


and twos. 
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Example 2.8 


Again consider the key example with M = 2, ae = 2 and 


M= 2. The fcllowing table shows 20 of the 90 states with 

their state numbers as provided by a lexicographic ordering 
of their ISTATEm1 vector representations. Both the ISTATEm1 
and ISTATE vector representations are given for each listed 


state. 
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The following is a diagrammatic representaticn of the 
ISTATEmM1 vector representations of three of the states. For 


reference purposes the state numbers have also been given. 
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Once a sequencing precedure has been established, it 


Can be used whenever needed to sequentially generate the 
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meates. If, on the otner hand, the states could be 
efficiently stored, they could be recalled from storage when 
needed rather than going through the sequencing procedure 
each time. In addition, a well-designed storage procedure 
can aid immeasurably in determining state numbers from 


vector representations. 


| Ferhaps the simplest storage procedure is tc store 
the vectors 1n an array, say NAME, so that NAME(i,j) 
SGentains the value of the j-th component of the ISTATE 
vector representaticn (or some other vector representation) 
Or State 1. This is easily seen to be inefficient. For 


example, in modeling the key example with He = 6, ie = 1 and 


M = 3, NAME would have to be dimensioned 840 by 10, 


creguiring 8400 storage locations. 


Next, consider converting each vector into a single 
Nugber and storing the number. For example, in the example 
just cited the state i whose ISTATE vector representation is 
Mee, 1, 1,1,1,3,1,9}, could be stored in NAME({i) as 
43101121111 (from the ISTATEn1 vector representation) cr 
17217111310 (from the ISTATE vector representation). This 
procedure appears to require only one storage location per 
State. dowever, there is a limit to the number of digits an 
integer stored in a computer can have. Storing in doubkle 
precision will double the space required to store the states 
and may nct be sufficient for some of the generalizaticns. 
On the other hand, if the states are stored according to the 
vector representation used to sequence tnem, the numpers 
Stored weuld be in ascending order, and an erficient search 
technigue cculd bre designed to determine tne state numter 


for a state given its vector representation. 


Eyesuoemng sce 2aractely the right and left subvectors, 


the space required to store the states can be reduced and at 
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the same time a more efficient method for determining the 
state number from the vector representation can be 
developed. Consider how this might be accomplished for the 
key example sequenced according to a lexicograpnic ordering 


of the ISTATEm1 vector representation. 


Each subvector will be stored as a single number as 
described above. In this way the 840 states of the example 
considered akrove would reguire 127 locations for storage of 
the 120 right subvectors and 7 left subvectors. The same 
problems arise concerning the number of digits a stored 
integer can have. However, since the left and right 
sukvectors are stored separately, the variety of cases which 
can be handled without utilizing double precision is vastly 
increased. In fact, in many cases storage of the balance 
equations and auxilliary storage required to solve them will 
cause core problems before there is any need to worry about 
utilizaticn of double precision for state storage. (The key 
example with a = 5, as = 3 and M = 4 results in 147,840 


terms in 27,720 balance equations. As indicated in 


esecticn 2.3 of Chapter [V, a case with 35,280 terms in 
6,930 balance equations reguired 396K bytes of storage on an 
IBM 360-67. Of this, nearly 127K bytes were reguired for 
storage cf the balance equations, state probabilities and 
State vectors. The earlier example would reguir2 over 527K 
bytes to store these same things.) furthermore, the idea of 
Splitting a vector into subvectors and storing only the 
Subvectors could be used on a sSubvector too large to stcre 


Baesingle precision. 
New, consider storage orf the left subvectors. 


Stcrage will be in terms of a single number for each 


Subvector. For example, if 7 = 2 and - = 3, {2,1,2,4, \} 
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mena Valid left subvector and will be stored as 21221. A 


computationaily efficient method of performing such a 
translaticn frem integer vector to integer scalar is given 
Seweatgorithm 2 in Appendix B. An easy dual to this 
algorithm can be used to produce an integer vector from a 
stored scalar. Stcrage of the left subvectors is 
accomplished by using Rule 3 of the ISTATEm1 procedure to 
successively generate the subvectors. Each time a new 
subvector is generated, Algorithm 2 can py used to determine 
the corresponding number to be stored. A computational 
method can be developed to derive each stored number from 
its predecessor by addition of some powers of 10 and 
Suktracticn of others based upon which components of the 
left subvector must be increased and which decreased to 


derive the next left subvector. 


Storage of the rignt subvectors may be accomplished 
in exactly the same manner. However, if the states are 
ordered according to the ISTATEm1 scheme, a relatively 
Simple computational scheme makes it possible to store the 
appropriate numbers without having to use Rules 1 and Z to 


successively generate the right subvectors. 


The numbers to be stored are all integers of M 
digits or less whose digits sum to N or less. These numbers 
are to be stored in groups with those whose digits sum to 
zero first, fcllowed by those whose digits sum to one, then 
two, and so forth up to those whose digits sum to N. Within 
each group, the numbers ar2 to be stored in ascending order. 
The number cf numbers in the x-th group (i.e., the numter of 
integers of M digits or less whose digits sum to xk) is 
C mene number of Combinations of M - 1+ k thincs 

S-1+k,k 
taken k at a time, which may be calculated from: 
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C =e / lee (nr)! 4 
Te 


Poem -tn group Contains only zero and is not stored. 
The 1-th group consists of a. = 1. 10. 10°. econ, Ome 
For k > 1, €ach number in the k-th group is the sum of a 
numker ‘in the i-th group and a number in the (k-1)-th group. 
Algorithm 3 in Appendix B uses these facts to store the 
right subvector in an array (KSTG) without generating and 
translating them. This algorithm also requires two 
auxiliary vectors, NSTG1 and NSTG2, each of length N. For 
R= 1, 2, ---, N, NSTG1(k) 1S the component number of the 
first and NSTG2(k) of the last number in KSTG in the k-th 


eecup. 
Example 2.9 


Consider the key example with a = 27 a = 2 and M = 2 


discussed in Examples 2.7 and 2.8. Recall that this system 
has 90 states so that storing each state as a single integér 
Would require 90 storage locations. By using Rule 3 of the 
lexicographic ordering procedure for the ISTATEm1 vectcr 
CTepresentaticn, the ieft subvectors can be stored ina 
mector LSTG: 
Prom — of 1122,1212,1221, 2112, 2121, 2211} 
Using Algcrithm 3 the right subvectors can also be stored: 
Perec = {1,10, 2,11,20,3, 12,21, 30,4,13,22,31,40} 
The tctal stcrage required (including four spaces each for 
the auxilliary vectors NSTG1 and NSTG2) is 28 spaces. Note 
that if ne use is to be made of the contents of NSTG1 and 
NSiG2 later, KSTG could be generated first and NSTG1 and 


NSTG2 cculd use the same storage locations as LSTS. 


Iwo guestions remain. First, how can the states be 
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sequentially generated once KSTG and LSTG have been filled 
in? Seccnd, how can the state number be determined frcm 
either the ISTATE or the ISTATEm1 vector representation of a 


state? 


First, observe that, based upon the three rules for 
ISTATEmM? lexicographic ordering, the left subvector 
successively takes on all of its possible values between 


sucessive changes in the right subvector. The answer to the 


first guesticn is now quite natural: 


mel JGOrlrenm £oOr 
Sequential Generation of States 


(1) Set the right subvector at its first feasible 
value, namely, all zeros. 

(11) To get the first k states, where k is the 
length cf LSTG, successively set the left 
subvectcr to the values indicated by the 
components of LSTG, leaving the right subvector 
fixed. 

(111) Repeat (11) with the right subvector set 


successively at the values indicated in KSTG. 


This procedure is demonstrated in Example 2.8. The numper 
of components of KSTG is the value of the last (N-th) 
component of NSTG2 if Algorithm 3 is used to store the right 
Subvector. The number of components of LSTG is the number 


Of distinguishable permutations of ae ones and - twos, 


Ce, 


lo deternine the state number of a state from either 
its ISTAIE or its ISTATEm1 vector representation, use the 


formula 
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f2. 1} state number = k x C + 
ase 


where the right subvector of the vector representation cf 
the state corresponds to the k-th component of KSTG (the 
zero vectcr corresfonds to the "0-th component" of KSTG), 
Smomene left subvector corresponds to the m-th component of 
LSTG. To determine the values of k and m, ccnvert the left 
and right subvectors of the state into integers and doa 
search through LSTG and KSTG. While converting the right 
subvector, the sum of the components should te accumulated. 
[Meet nis SUM 1S zerc, k = 0. If the sum is s # 0, then KSTG 
need Fe searched only from component NSTG1(s) to component 
NSTG2(s). A search in LSTG is simplified by tne fact that 


the values of the compcnents increase with ccmponent number. 


Algorithm 4 of Appendix B gives an alternative to a 
search in LSTG. No comparison has been made between this 
algorithmic frocedure and a search procedure. It seems 
likely that the search procedure is better when the length 
of LSTG is relatively small, and the algorithmic procedure 
is better when it is relatively large. It is not known 
Whether tke algorithm can be extended to cases in which the 


number of jor types exceeds two. 


The develcpment in the preceding subsection still 
applies with the obvious change of Rule 3 for lexicographic 
Sequencing of the states according to the ISTATEm1 vector 
representaticn: 


Rule 3: The last N components consist of ve ones, 


- twoS, ee, N K's where K is the total number 
K 
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of job types. 
The combinatorial term in (2.1) must be changed to 


Niy(N IN 2...N $) 
f 2 K 


Example <z.10 


Suppose K = 3, ae 2 N= Ny ae = 1and MW = 2. Then 


KSTG is éxactly as reported in Example 2.9 and 
mete ni2o, 1 1o2,1213,1231, 1312, 1321,2113,2131,2311, 
Sr eeste lie 1 1} 

The combinatorial term to be used in (2.1) is C = 
Q'y(2!1!1!) = 12 which can be verified by counting the 
ccmponents of LSTG. Using (2.1) we will now calculate the 
state number for the state having ISTATE vector 
Mmepresentaticn {1,3,t,2,0,3}. Note that its ISTATEm1 vector 
Mepresentaticn is {3,0,3,1,3,1,2}. Its left subvector 
Meeeesponds to 1312, the fifth component of LSTG. Its right 
Sulvector corresponds to 3, the sixth component of KSTG. 
M@mewstate number is : 6 x 12+5 = 77. The total numter of 


states is 180. 


nera CupeiVuNner Of SeCEVeLs 


3.4. Generalizatio 


First consider the case in which the CPU is the only 
Multiserver gueue with L 2 2 servers. Then, as pointed out 
in subsection 2.3, the order of the jobs in service at the 
CPU 1S immaterial. The result is that some states will be 
represented more than once in a lexicographic ordering of 
the states (whether based on the ISTATE or the ISTATEn1 
vector representation). One way to handle this problem is 
to redefine the left subvector to be "those of the first N 


ccMponents representing jobs not in service at the CPU." 
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Note that this leads to a variable-length left subdvector. 
When the numker of jobs at the CPU is zero, the length of 
the left subvector is N. When the number of jobs at the CPU 
is N, the length of the left subvector is N- Lif L < N or 
zero if the CPU is an IS queue. Since the left subvector is 
at the right side cf the ISTATEm1 vector representation, an 
advantage is realized by sequencing the states according to 
this representation. Namely, by revising the sequencing 
procedure to ignore a number of components at the right end 
of the vector (where the number to be ignored can be 
calculated from the first component of the vector), no 
States will be duplicated. This can be accomplished by 
Changing Rule 3 (for the lexiccgraphic ordering procedure 
meretne ISTATEm? vectors) to read: 

Rule 3: Tne last m = min(L,N-k) components (where 

k is the value of the first component) are all 

zeros. The N - m components immediateiy preceding 

these consist solely of ones and twos. There must 


be ne mcre than \ ones and no more than we twos. 


When storing the left subvectors (as redefined 
abcve), those cf zero length are not stored. Those of 
positive length are stored in ascending order. Thus, the 
Shertest subvectors are listed first, followed by the next 
Sacrtest, and so forth up to those of length N. Several 
auxiliary vectors may be maintained to aid in determining 
State numbers from vector representations and sequential 
generaticn of the states. For example, NSTG2 may be used to 
meeaeintcrmation concerning the location in LSTG of the 
beginning and end of each group cf numbers. For k = 1, 2, 
---, N, component NSTG2(k) + 1 would contain the first and 
NSIG2 (k+1) the last of the k-digit numbers in LSTG. Using 
Rule 3, the subvectors can be sequentially generated by 
allowing m to successively take on values from min(L,N-1) 


down to zero and, for each value of mn, generating in 





lexicograrfhic order all feasible left subvectors of length 
N- m. Each time a new subvector is generated it is stored 
in LS@TG, and each time the value of m changes the 
appropriate component of NSTG2 would be given a value. 
However, aS pointed out in Algorithm 5 of Appendix B, cnce 
the shortest subvectors have all been stored in thisS manner, 
a computational scheme can be used to £111 in the remainder 
Of LSTG and NSTG2. This aigorithm utiiizes the fact tkat 
each (k+1)-digit number in LSTG is the same as some k~-digit 
humber in LSIG with elther a one or a two attached to its 


right end. 


After an exampie consideration will be given tc the 
two recurring guestions: How may the states be sequentially 
generated frcem the stored subvector? And how can the stata 


number be derived from the vector representation? 


Example 2.11 (a) 


Consider a model similar to the key example except 
that the CPU 1S a nultiserver with L = 2. Suppose e =ae7, 


ys = 3 and M = 2. The minimum length of a left subvector 


Seerted in LSTG is max(1,N-L) = 3. Tne steps of Algorighm 5 
yield: 
fmeustGz(1) = 0, NSTG2(2) = 0, NSTG2(3) = 0 
Men) Starting with the first component, LSTG = 
mimi 1, 122,211,212, 221,222}. Note that 111 is 
not stored since Ni = 2. 
fea) NSTG2 (4) = .7 
(lv-vii) LSTG (8) 1122, derived from LSTG(1) 
LSTG (9) Pelee, derived from LSiG (2) 
LSTG (10) = 1221 and LSTG(11) = 1222, botk 
derived from LSTG (3) 
Starting at the twelfth component, 


low 





moe = 9 {2112,2121,2122, 2211, 2212, 2221} 
tera) NSTG2(5) = 17 
(iv-vii) Starting at the eighteenth component, 
Memeoe— {11222,12122,12212,12221, 21122,21212, 
fae, 22112,22121,22211}. 
Mia) NSTG2(6) = 27 
An applicaticn of Algorithm 3 yields; 
ome te 10,2, 11,20,3, 12,21,30,4,13,22,31,40,5,14, 
23532, 4 1,5 90} 
and 
meee = {1,3,6,10,15,21} 
where the last ccmponent of NSTG1 has been put in so that 
for kK = 1,2,:,4,5, the numbers in KSTG whose digits sum to k 
Start at component NSTG1(K) and end at NSTG1(k+1) - 1. 


Using the results of this example as a guide, it can 
be seen how the states may be generated sequentially fron 
M@ewantoOrctation stored in KSTG, LSTG, NSTG1 and NSTG2. 

First set the right subvector at its first feasible value, 
the zero vector. The length of the left subdvector is k = 
max(0,N-L) since all N jobs are at the CPU. If k = 0 (i.e., 
1m£ the CPU is an IS gueue), then there is one such state. 


(The left subvector can be filled in with N ones and N 
1 
Mees in any crder if an ISTATE vector representation is 


Bequired.) If k > 0, then leaving this right subvector 
fixed, generate successive states by successively setting 
the left subvector egual to the values indicated by the 
humkers stored in LSTG from component NSTG2(k) + 1 to 
Cccmponent NS7TG2(k+1). Prom this point on, the successive 
States are generated by setting the right subvector 
Successively to the values indicated by the numbers stored 
in KSTG, for each right subvector, determining the length, 
kK, of the left subvector and setting the left subvector 
Successively to the values indicated by the numbers stcred 


in the appropriate section of LSTG. Note that k need not be 


108 





recalculated each time the right subvector is changed since 
jeewiilt be constant for all components of KSTG fron 
ccmponent NSTGi(m) to component NSTG1(m+1) - 1, for a 
es -, NN. 


ii 
_ 
= 


Example 2.11(b) 


The following table lists the value of the KSTG 
ccmponent used to derive the rignt subvector and the value 
of the LSTG ccmponent used to derive the left subvector for 
45 of the 18C states. 


feeeKSTG STG NS KSTG  LSTG NS KSTG  LSTG 
1 0 112 16 10 121 go 4 DID | 
2 0 121 21 10 222 Sia 1122 
3 0 ie 22 2 112 91 22 1122 
m 0 Zale 28 2 DAG: ieee 0 1122 
5 0 212 35002«417 222 120 40 22217 
6 0 De ie» 20 LOD 121 5 11222 
7 0 222 49 3 222 122 5 £12122 
8 7 112 56 0612 DAD 123 5 12212 
9 1 127 Gen ¢ si DDE 130 5 22211 
10 1 122 one 30 DED imme 2220 
17 1 ii 71 m th? 150 23 22211 
2 1 212 72 4 1212 yey 2 Bea] 
13 1 ZT 73 4 1221 178 50 22112 
14 1 DDD 74 u 22 2 eX PTE 
15 10 112 75 m 2112 0 0) 2227 ¢ 


New, consider how to determine the state number from 
the vector representation of a state. The right subvector 
Can be translated into an integer and located in KSTG. This 
Search can be simplified by use of NSTG1. From the right 
SuEvector can be determined the appropriate length, k, of 
the left subvector. The first k components of the ISTATE 
vector representation is the left subvector. This can be 
translated into an integer value and located in LSTG. Use 
SeehsitG2 will simplify this search. Unfortunately, a simple 
POrmula such as (2.1) cannot be applied at this point. In 
contrast to the key example, the number of states associated 
With each ccmponent of KSTG prior to the component under 
consideration may not be constant. However, this difficuity 


©an be overccme Since this number is constant within the 
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memes Of KSIG. That is, the sum of the digits of a 
ccmponent of KSTG, Say s, determines the length, k, cf the 
left subvector which, in turn, determines the number of 
states associated with that component of KSTG. Thus, the 
Same number of states 1s associated with each component of 
KSIG having the same value for s. An auxiliary vector, 
NSTG4, of length N can be used to store the total number of 
states associated with all components of KSTG prior to each 
grcup of ccmpcnents of KSTG. The information in NSTG1 and 
NSTG2 is all that is necessary to determine the values of 
the compcnents of NSTG4. Algoritnm 6 of Appendix B 


acccmplistes this task. 


The state number can now be determined from the 
vector representation. Suppose that the sum of the 
components of the right subvector is s and the right 
Subvector corresponds to KSTG(j), where j = 0 if s = 0. (if 
s # 0, the search for j should take place between components 
NSTG1(s) and NSTG1(st+1) ~- 1 of KSTG.) From s we determine 
that the length of the left subvector is k = max({s,N-L). 
Suppose that the left subvector corresponds to LSTG(i), 
where 1 = 0 if k = 0. (If k # 0, the search for i should 
take place between components NSTG2(k) + 1 and NSTG2(k+1) of 
LS1G.) The state number is given by: 


state number = [j - NSTG1(s) Jx[ NSTG2 (k+1) - NSTG2 (k) ] 
Teo eNSeGZ (k) i + NSTG4(s} 


where NSTG1(0) = 0, NSTG2(0) = 0 and NSTG4(0) = 11 k = 0 
and NSTG4(0) = 0 otherwise. 


Example z.11(c) 


Using Algorithm 6, NSTG4 = {7,21,42,70,120}. (Nete 


that all cf these states are in the table in part (6b) of 





this example.) Consider calculation of the state number for 
meee = {(1,2,1,2,2,3, i}. Note that s = 3+12= 4, NSIG1(4) 
= 10, k = max(4,5-2) = 4, NSTG2(5) = 17 and NSTG2(4) = 7. 
The right sukvector corresponds to 31 = KSTG(13), so j = 13. 
mumee kK = 4, the left subvector is 1212 = LSTG(9), so i= 9. 
Finally, NSTG4(4) = 70. So the state number is 

[13 - 10]x(17 - 7] + [9 - 7] + 70 = 102 


Now suppose that the multiserver gueve is one of the 
PP's rather than the CPU. Then all of tne above can be used 
if the left supvector is redefined to consist of "those of 
the first N components of the ISTATE vector representation 
representing jcbDs not in service at PPj," where PPj is the 


Multiserver gueue. 


A more difficult casé is one in which two or mere 
prcocessors are multiserver queues. For example, consider a 


Case in which PP1 has b, servers and the CPU nas L servers 
C 
(coth larger than cne). Conforming to the above procedure, 


define tne left sukvector to consist of "these of the first 
N ccemponents cf the ISTATE vector representation 
representing jcbs not in service at either PP1 or the CPU." 
A new prcklem arises in this case. This problem is 


illustrated in the following example. 


Example z.12 


Considér a case in which LF = 4, ale = 4, M = 3 and PP1 


and the CPU are IS queues. Then associated with a ieit 
Subvector = {1,1,2,2} and a right subvector = {2,3,1} are 
three states. Note that two i's and two 2's are distributed 
between PF1 and the CPU, two jobs going to each processor. 
The three states arise by assigning both type one jobs, or 


Meta type two jobs, or one job of each type, to the CPU. 
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This problem may be handled by the addition of a 
Single ccmpenent on the right end of the left subvector 
specifying, for example, the number of type one jobs in 
service at PE1. However, Since the maximum value of this 
added ccmponent depends upon the value of the first 
component of the right subvector, some of the resulting 
values in the appropriate section of LSTG may need to te 
bypassed fcr some right subvectors. This fact, along with 
the multiplicative effect that addition of such a compcnent 
has on the lengta of LSTG and tne fact that further 
ccmponents must be added as the number of multiserver queues 
increases, makes separate maintenance of this information a 
more attractive option. Such separate maintenance might 
involve creation of another storage vector, say MSTG, and an 
associated pcinter vector, say NSTGS. The details of this 


procedure will not be discussed here. 


Note that this problem disappears if only one type 
of job can route to each multiserver PP. This is the 


subject cf the next subsection. 


Pee A Specialization: 


== Sr sew SE oe ee eee == See ee ae ee we SS 2S Ss 


Ccnsideéer a svecial case of tne key example in Which 
ALFA(1,1) = OQ; i.e., only type-two joos are allowed to route 
MoerP1. AS a result, the order of job types at PP1 is not 
Meeded in specification of a state. In cther words, ac 
informaticn ccncerning PP1 need be retained in the left 
Supvector. The left subvector may be defined to consist of 
menOse Of the first N components not representing jecbs at 
PP1." In such cases, variable lengtn lert supvectors as 
discussed in subsection 3.4 are quite useful. In fact, if 
Only one type of job nas zero prancning propabdilities, some 
of the procedures discussed above may be simplified. As an 


alternative, the normal procedures for the key example as 








discussed in subsection 3.1 and 3.2 could be followed 
ignoring the fact that many of the represented states are 
invalid. The final steady-state probability distribution 


Will assign zero probability to each of the invalid states. 


As a complication, suppose (in addition to ALFA(1,1) 
= 0) that the CPU is a multiserver queue. Then a subtle 


problem arises. Consider the following example. 


Example 2.13 


Suppose ALFA(1,1) = 0 and the CPU is an IS queue. 
Consider using the ISTATEm1 techniques discussed earlier in 
this section. Defining the left subvector to consist of 
these of the first N components of the ISTATE vector 
representaticn not representing jobs at PP1 or jobs at the 
CFU, the length of the left subvector is the sum of the 
components of the right subvector less the first component. 


Suppose = = 4, . =o anda = 3.) Then the portion of LS?TG 
ccntaining four~digit numbers is; 


mee wreldiiz 4121, 1122,1211, 1212, 1221,1222,2111,2112, 

Bere 2 122,2211,2212,2221} 
Each of these ccmponents can be used to generate state 
vectors if the right subvector is {0,3,1}. However, 
consider the right subvector {3,3,1}. The length of the 
appropriate left subvectors is again four. But, the fact 
that three of the four type-two jobs must be located at PP! 
forces frcem consideration any left subvector containing more 
than one 2. Thus, the components of LSTG usable in this 
case are: 

Meet. tit2, 1121, 1211,2117} 


Note that it is necessary to skip around in LSTG. 


To take care of this problem, another vector 


ns 





representaticn, hereafter called the ISTATEm2 vector 
representaticn, has been daveloped. Although its 
applicaticn is more important for cases such as that 
discussed in Example 2.13, tne ISTATEm2 vector 
representaticn is introduced here in terms of the key 
example sc that ccmparison with the ISTATE and ISTATFm1 


vector representations may be clearly seen. 


The ISTATEm2 vector representation of the states of 
the key example is a vector of length N + M + 2 whose first 
cemponent is the sum of the components or the right 
Subvector, whose next M components form the right subvector, 
whose next ccmponent is the total number of type-two jobs at 
the PPP's, and whose last N components form the left 
Sukvector. The ccnstraints used in the lexiccgraphic 


ordering prccedure for these vectors are: 


ISTATEm2 Sequencing Constraints 
Rule 1: The first component iS a nonnegative 
integer, k, no larger than N. 
Rule 2: The next M4 components are nonnegative 
integers whose sum is the first component. 
Rule 3: The next component is a nonnegative 


integer which can be no smaller than k - se and ne 
larger than the smailer of k and NG 

Rule 4; The last N components consist cf Ny ones 

and ve twos. Tne first k of these contain exactly 


the number of twos svecified by the (M + 2j-nd 
component (see Rule 3). 





Example z.14 


Again consider the key example with . =e Sa = 2 and 


M= 2. (See Fxamples 2.7 and 2.8.) The following table 
shews 13 cf the 90 states with their state numbers as 
provided by a lexicographic crdering of their ISTATEm2 
vector representaticns. For reference purposes all three 
vector representations discussed thus far are listed for 


each state. 


NS ISTATEnm2 Dotan ISTATEm1 

1 O00, 07 els Ze2 neg, 0 7 0 OF O gO gag: lige 2 
aoe 2 PAO 2 a a, ee 2 9 Peep Oly Coe ecg 
36 ee pU, cee ges 4's | Zee elgic 7 0 Bae Ue pie else 
a / eo gn alee 7c Weta cricy 7s So SEW AS At GAs Ae 
38 Bil, J lee, lp e aL Ze. BO pohly 25 lope 
a9 Mog lg lees by, 1g Z Zieeeetirse G0 g 3 igs pinks te 
4Q Ue cy 2a lets Ze! 2 0-3 SO elec st 
4 3) AO 4 eet Sale e gS SOG lee 
42 Sy OI a PAL Ze ly pcg oe leg 
43 341,2,1,1,1,2,2 lealeecte es li, ec ie, leone 
45 Ele es lye, ll, |,2 PEM, Nec lg2 SR es hos 6 
46 De lele lteter ss | Un Ape ae a ae Vg cieg 2 ove Gi | 
90 MAG Ue 2, 2e2r7 ly! Oop ay BNP PO, DT pA! ee eal 


In this example there is littie difference between 
the order of the states when the Sequencing procedure is 
based on the ISTATEm1 vector representation and when it is 
based on the ISTATEm2 vector representation. An occasional 
pair of states (such as states 39 and 40) are reversed in 
order. In the following example the difference is more 


prcenounced. 


Example z.15 


Consider the key example in which a = 4, a = 3 and M 


— 


=z. The fcllowing table shows 24 of the 1260 states With 
their state numbers as provided by a Lexicographic crdering 
Of their ISTATEm2 vector representations. Note, for 

example, that for state number 561, the first component of 


the ISTATEm2 vector representation indicates that there are 
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five 
that 
PP2. 
five 


Hepe at the PP's. 


one cf these is at PP1 and the remaining four are at 


is a type-two job. 


The next two components indicate 


The fourth component indicates that only one of the 


The remainder of the vector 


indicates that the job at PP1i1is a type-one job, the 


type-two job is the one in service at PP2, 


joks are at the CPU, 
NS 


NWA NINN u1ino1wn 
NANNNONINES & WwW WwW WWW pohbohd bo 
a OWA RB OWW es OMAN NES WBwBOW@dOwsnMN 
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ISTATEm2 
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and two type-two 


Lespite the introduction above, the ISTATEm2 vector 


representaticn 1S not particularly useful for the key 


example. 


Subvector has variable length. 


Ccnsider the case in which ALFA(1,1) 


1s a multiserver gueue with L 


> 


2 servers. 


BeevectOr contains the job types at PP2, .. 


engueued at the CPU. 


jme first A + 1 


ines TObe USectul in Cases in which the left 


= 0 and the CPU 
The left 
, PPM and 


components of tne 


ESTATEm2 vector representation of states of the system are 


defined as akove. 


total number of type-two jobs at PP2, ..., 
at the CPU, cr eguivalently, the total number of twos in the 


left subvectorc. 


Redefine the next component to be the 


PPM and engueued 


This is followed by the left subvector and 








whatever zeros are required to complete the N + M + 2 
components. Rules 3 and 4 must be changed to conform to 
this redefinition. The fact that only type-two jobs can 
route to FPR1 forces a change in Rule 2 also. The complete 


PereorL rules is: 


LSPAlLEm2 Sequencing Coastraiats 
Rule 1: The first component, k, is a nonnegative 
integer ne larger than N. 
Rule 2: The next M components are nonnegative 


integers, the first of which is no larger than es 


The sum of these components must be k. 
Rule 3; The next component is a nonnegative 
integer which can be no smalier than the larger of 


k=-n -N andN - n -L, and which can be no 
1 1 2 1 
larger than the smaller of a = oe and m, where n 


is the second component (i.e., the number of jobs 
at PF1) and ma = k - ae fanax(0,N—K-L) 15 the 


length cf the left subvector. 


Rule 4: The next m components consist solely of 
ones and twos. The number of twos among the on 
compcnents is tno2 value of the (M + 2)-nd 
component (see Rule 3). The last N - m components 


are all zeros. 


As can be deduced from our wiliingness to change the 
description cf a vector representation to meet specific 
Situations without changing the name of the representation, 
the name cf a vector representation does not denote a 
Specific set of rules. Rather, it denotes a type of 
Ordering of the states. For the ISTATE vector 
crepresentaticn, the right subvector is varied for each value 


Of the left subvectorcr. POtmEmMo LSOTATED! and 2STATEmZ vector 


Va? 





representaticns, the left subvector is varied for each value 
of the right subvector. For the ISTATEm1 vector 
representaticn, the appropriate left subvectors are arranged 
in lexiccgraphic crder for each right subvector. As seen in 
Example 2.13, this arrangement is not convenient for scme 
applications. The following example shows the ISTATEm2 
@eeamgement of left subvectors for each right subvector in a 


specific group for the case discussed in Example 2.15. 


Example z.16 


Consider again the case in which ALFA({1,1) = 0, the 


CEU is an IS queue, B = 4, a = 3 and M = 3. For the case 
of lexiccgrafphic sequencing according to the ISTATEm2 vector 


representaticn, the four-digit components of LSTG are: 
meme tic, dez2t, 1241,2111,1122,1212,1221,2112,2121, 
Mem t222,2122, 2212,2221} 
Note that for the right subvector {0,3,1} each of these 
Semconents of LSTG will provide us with a valid state. For 
the right sukvector {2,3,1}, only the first five components 
Of LSTG will yield valid states. The advantage of the 
ISTATEm2 vector representation is that these five compcnents 
are in consecutive storage locations. Compare this with the 
Mot OL Example 2.13. With right subvector {1,3,1} we 
associate tke first eleven components of LSTG and with 


mo, i}, cniy the first one. 


From Example 2.16 it iS apparent that procedures 
are needed fcr storing the numbers of LSTG in the 
appropriate crder and for efficient determination of which 
cctponents of LSTG to use with each right subvector. For 
storage cf the numbers in LSTG according to a lexicographic 
crdering cf the ISTATEm2 vectors, a modification of the 


algorithm given for the ISTATEm1 case is possible. 





Algorithm 7? cf Appendix B provides an alternative to such a 
modification. First, note that because of the way LSTG is 
used, it does not matter whether all of the one-digit 
numbers are fcllowed by the two-digit numbers, and so forth 
up to the N-digit numbers, or the reverse, or any other 
arrangement. It 1s Simply necessary to be able to quickly 
determine the beginning and end of each group. In view of 
Example 2.16 it 1s apparent that determination of where the 
Number of ones (or twos) changes, even if the number of 
digits does not, is also reguired. In Algorithm 7 the 
ccmponents of LSTG are arranged so that the numbers with the 
largest number of digits are first and the smaliest last. 
NSTG3 is used to store pointers to the locations in LSTG 
where either the number of digits or the number of ones 
changes. NSIG2 is used to store pointers to the locations 
in NSTG3 where pointers to a change of digits are stored. 
Recall that the case under consideration is the key example 
except that ALFA(1,171) = 0 and the CPU is a multiserver queue 
With L servers. In particular, all processors except FP1 


are assumed to accept both types of jobs. 


Example z.17 (a) 


EOL a = 2, a = 2 and L2 2, Algorithm 7 yields: 


em ile 2 e222 1, 2112,2121,2211,112,121,211, 
Ween 2 ts it, 12,21,22, 1,2} 

memes = {1,7, 10, 13,14, 16,17,18,19} 

HerG2 = {7,4,2,1} 
Meeemconat £or j = 1,2,...,98, all numbers in LSTG fron 
Somponent NSIG3(j) through NSTG3(j+1) - 1 have the same 
humbers of digits and the same number of ones. Furthermore, 
eee 1,2,2,4, LSTG(NSTG3(NSTG2(i))) is the first i-digit 


member stcred in LSTG. 


Cnce LSTG, NSTG2 and NSTG3 have been developed using 





Algorithm 7, the components of a right subvector contain the 
informaticn required to determine which components of LSTG 
contain valid left subvectors for that right subvector. For 


example, if a is the first component of the right subvector 


(i.e., the number of jobs at PP1) and k is the sum of its 


components, then m = k - - + max(0,N-k-L) is the length of 
each valid left subvector, j = aN) is the largest 
feasible number of ones, and i = ses Ia ee is the 
smallest feasible number of ones. Note that, once m has 
been determined, j is independent of oF This, tnewvaiid 
left subvectcrs begin in component NSTG3({NSTG2(m)) of LSTG 
mmoecun through cogponent NSTG3(NSTG2(m) + j - 1) - 1. 

Be tar the fact that Rule 2 restricts the value of 


the first ccmfonent of a right subvector to be no larger 


than wy has been neglected. As a result Aligorithm 3 fcr 
computaticnal generation of KSTG and NSTG1 must be revised. 


Briefly, if the sum of the components of the right subvector 


is i. + d, then the number of components in KSTG 
corresponding to this sum of components must Le reduced by 
@ . This correction can be made easily in Algorithm 
frd-2,d-1 

a 


Example 2.17 (£) 


If M = 3, the modified algorithm for right subvectors 


yields: 
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eee it, 0, 100, 2,11,20,1C1,110, 200,3, 12,21, 30, 
Orpen o1,210,4,13,22,31,40, 103,112, 
i2 epmtenter 2 O02 2 lien 2 2 C} 
and 
MorGt = {1,4, T05 19,31} 


At least two options are available for calculation 
of state numbers from vector representations. A vector 
NSTG4 which has the same length as KSTG could be used to 
store, fer example, in NSTG4(1), the number of states frior 
to the first state using the corresponding right subvector, 
KSTG(1). Given a state vector in this case, the length, no, 
of the left subvector, the value of 1 such that the right 
sukEvector is stored in KSTG(i) and the value of j such that 
the left subvector is stored in LSTG(j) would be determined. 


The state numker is then 


State number = NSTG4Y(1) + j + 1 - NSTG3(NSTG2(m)) 


As an alternative NSTG4Y could be shortened by uSing 
the fact that the number of states associated with each 
Cight sukvector changes when either the sum of the 
components cfr the right subvector or the value of its first 
component changes. A vector, say NSTG5S, could then be used 
to point to the components of KSTG where either the first 
component or the sum of the components of the stored right 
Subvectors changes. NSTG1 would be modified to point tc 
NSTGS the same way that NSTG2 points to NSTG3. NSTG4(i) 
would contain the number of states prior to the first state 
USing the right subvector stored in KSTG(NSTG5(i)). Thus, 
the length of NSTG4Y would be the same as that of the new 
vector NSTGS, making this procedure less efficient (in terms 
of storage reguirerents) unless the length of NSTG4 was cut 
at least in half. In addition, the work required to 
Calculate the state number would be increased. The equation 


moe He used is: 
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state number = NSTG4(1) + [n + 1 - NSTG3(NSTG2 (mM) ) ] 
+ {3 - NSTG5 (i) Jx[ NSTG3 (k+1) - NSTG3(NSTG2(m)) ] 


where j is the integer such that the right subvector is 
stcred in KSiG(j), 1 is the largest integer such that 
NSTG5({i) < j, 0 is the integer such that the left subvector 
is stored in LSTG(n), m is the length of the left subvector, 
and k is the largest integer such that LSTG(NSTG3(k)) isa 
legal left subvectcr for use with the given right subvector. 


3.6. Generalization of Queuing Discipline 


SP ey cae eee ob -ob Se Se ae ee = <-> 


MmerS,eeecrosPR, LCFSPRpt: The state vectors are the 
Same as in the FCFS case. Only the interpretation differs. 
Thus, unless the service distributions are nenexponential, 
or blocking cr bulxing is possible, storage and sequencing 
of states and determination of state number from vector 


representaticn is as discussed in the preceding subsections. 


Preemptive Priority: The order of job types at any 
processor having this gueuing discipline need not be 
considered a fart cf the left subvector. What is needed is 
the number of each type of job at seach of these processors. 
Hence, cases such as these can be handled the same way IS 


queues are handled. 


Nonpreemptive Priority: In addition to the 
informaticn reguired for preemptive priority queues, the 
tyre cf job in service is reguired. This may be handled by 
treating nongpreemptive priority queues the same way 
preemptive priority gueues are handled but including the job 
Myre of the job in service in the left subvector. A 
complication arises in this case which does not arise in tne 


preemptive priority case if the gueve is a multiserver queue 
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as well. The types of jobs in service cannot be added to 
the left subvector since their order is immaterial. 
Instead, the number of type one jobs, for example, in 
service at each such queue should be appended to the 
subvector which contains information about the number of 
each type of job at each priority queue. 

Pea tn ertrect a PS queve is an IS queue with 
state-dependent service rates. PS queues may be handled in 


exactly the same way that IS queues are handled. 


3.7. Generalization of Service Distributions 


Unfortunately, the relatively compact storage 
schemes and elegant procedures for sequential generaticn of 
the states and for determination of state numbers fron 
vector representations presented earlier in this secticn 
extend tc cnily a few specific cases when nonexponential 
service distributions are introduced. In this subsection a 
precedure for handling many general situations will be 


Suggested. 


Consider a model in which there are generalized 
Erlangian service distributions such as those discussed in 
subsecticn 4.1 of Chapter I. Then, an array NUM must te 
Maintained as a part of the model description. NUM (i,j) 
Should be the number of stages associated with the service 
distribution of type-i jobs at processor j. In order to 
completely describe a state of the system, a number, say K, 
cf components must be appended to any vector representation 
to contain informatic¢cn concerning stages of service. 
(Depending urfon the situation, K may vary from one to Zz x 
N.) Hereafter this collection of K components will be 
referred to as the far subvector. In all three vector 


representaticns discussed above, the far subvector can De 
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attached to the right end and rules to govern the selection 


of values fcr its compcnents can be added. 


Example z.18 


Consider the case in which each processor is a FCFS, 
single server queue with generalized Erlangian service 
distributions. Then the far subvector is of length M + 1. 
The j-th ccmponent of the far subvector contains the stage 
of service fcr the job in service at processor j. The 
conventicn wiil be to assign the value of one to e2ach 
component which corresronds to an idle processor. For a 
Memrcograrphic ordering of the ISTATE vectors for this 
system, the following rules should be added to the two rules 


maeesubvector 3.1: 


Rule 3: The next M components are positive 
integers such that the j-th of these is no larger 
than cne if ISTATE(N+j) = 0, and otherwise is no 
darger than NUM(1,j3), where 11s the value of 
component [ISTATE(N+1) + ISTATE(N+2) + ... + 
MmorAlE(N+3}) |] of ISTATE. 

Rule 4: The last component is a positive integer 
which is no larger than one if the sum cf the 
compcnents of the right subvector is N, and 
Otherwise is no larger than NUM(i,M+1), where 1 = 
ISTATE(K). 


Since the far subvector is at the right end of any 
VECtOr representation of the states, a choice of left and 
Tight subvectors leads to a group of states. Thus, to 
sequentially generate ail of the states, it is necessary 
Cniy to seguentially generate the left and right subvectors 
as described in the preceding subsections and, each tise 


Sither the left or the right subvector changes, generate ail 
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Meelrcable far subvectors. The right and left subvectors 
(and asscciated pointers) can be stored as described in the 
preceding suksections according to the sequencing procedure 
used. The mcdus operandi will be to not store the far 
subvector. Each time the states are (sequentially) 
considered, géeneraticn of the associated far subvectors may 
be accomplisked py performing the lexicographic sequencing 
procedure (see subsection 3.1) using constraints similar to 


Rules 3 and 4 in Example 2.18. 


The remaining guestion is how to determine state 
numbers frcm vector representations. (ES TATEMIPOre! Ss ATEm 2 
sequencing will be assumed.) To aid in this effort create a 
vector, NSTG4Y, having the same length as KSTG. NSTG4(i) 
wili be the number of states preceding the first state 
having KSTG(i) as its right subvector. Now suppose a right 
Sukvector and a left subvector which is valid for the right 
Subvector are given. Create a vector, MAX, cf length K (the 
same length as the far subvector) suca that MAX(k) is the 
Pargest value the k-th component of the far subvector can 
take on subject to the constraints imposed by the given 
Tight and left subvectors. In many models the conpcnents of 
the far subvector can take on values independently of each 
Other. That is, the values that any given component can 
take on are net restricted in any way by the values the 
Other comgcnents have. For these models, each vector from 
the vecter cf all cnes through MAX is a feasible value for 
the far subvector. (f= A and B are vectors of the same 
length, A <s E means that each component of A is less than or 
egual to the corresponding component of B. This last 
Sentence means: vector of all ones < A S$ MAX implies that A 
1S a valid far subvectcr for the given right and left 
Seovectors. Ey construction of MAX and convention for far 
Subvectors, the reverse implication is also true.) Thus, 
the number of states having the given right and left 


sutvectors is the product of the components of MAX. 
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Given a particular far subvector, MAX may be used 
also to indicate its relative position among all far 
sukvectors which are valid for the given right and left 
subvectors. Algorithm 8 of Appendix B specifies how this may 
be done. Algorithm 9 in the same appendix may be used to 
determine the state number of a state from its vector 
representaticn for models like those discussed in the 


preceding paragraph. 


cor cases in which the components of the far 
sukvector are not independent of each other, decompose the 
far supvector into subvectors such that the components are 
independent of each other within each subvector but 
ccmponents of all subvectors but the first depend upon the 
values in the preceding subvector(s). Then attempt to 
iterate the above process. This, of course, iS a very 


couplicated procedure at best. 


The nmcedel considered in this subsection is the key 
example excert that the capacity of the CPU is C joks, where 
C is a positive integer smaller than tne total number, N, of 
Jobs circulating in the system. (Ii C 2 N, the CPU 
effectively has infinite capacity since no blocking can 
occur.) Other possible models are lart to the reader. 

Since the CPU has a finite capacity, the potential exists 
mer pLocking to occur at any of the PP's. As discussed in 
Subsection 2.6, M components will be added to the vectcr 
representaticn of a state, one for each PP to indicate its 
bleckedynet blocked status. Hereafter these M components 


Bee Calied tke blecking subvsector. 


Spomvayero nandie this situation is to set a 


Ccmronent of the blocking subvector equal to two if the 








m@eetesponding FP is blocked and one if it is not, and use 
the procedures discussed in the last subsection. However, 
Since the possible values of the components are independent 


of the left subvector, a more efficient scheme is possible. 


Using the terminolgy of subsection 2.6, assume that 
a priority cr probablistic scheme is being used to determine 
which of the blocked PP's will be unblocked when a service 
ccmpleticn takes place at the CPU. In particular, set the 
j-th compcnent of the blocking subvector equal to one if PPj 


MmempLocked and zero if not. 


The ISTATEm1 and ISTATEmM2 vector representations 
(with the blilccking subvector at the right side) are 
preferred over the ISTATE vector representation for twe 
reasons. First, once the right subvector has been 
Specified, the whole range of possible blocking subvectors 
Can be determined. Second, the fact that the CPU has a 
finite capacity implies that there is a positive nininun 
feasiktle value for the sum of the components of the right 
Buevector, i.e., the first component of the ISTATEm1 and 


ISTATEmM2 vectcr representations. 


Suppcse that a right subvector is specified. If the 
Sum of its ccmponents is greater than N - C, no blocking can 
Mecur. Sc consider the case in which this sum equals N - C. 
Meche j-th ccmponent of the right subvector is zero, so 1s 
the j-th compenent of the plocking subvector since an idie 
processor cannot ke blocked. Removing these components from 
the blocking subvector, we are left with a L-locking 
Subvector whose length is the number of nonzero terms of the 
Specified right subvector. Each component of this shortened 
blocking subvector can independently take on either of the 
values zero cr one. USing the techniques for storage and 
handling cf variable-length vectors discussed in subsections 


3.4 and 3.5, these shortened blocking subvectors could be 
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stored for later use. Indeed, this is necessary if a FIFO 
or LIFO unbiccking scheme is used. But in the present case 
the ract that the stored numbers are binary can be used to 
avoid storing any information at ali concerning the blccking 


subvectors. If the right subvector has m ncenzero 

a 
components, there are 2 feasible (shortened) blocking 
subvectors, and they are represented by binary 


m 
representaticns of the integers from zero through 2 - 1. 


Example 2.19 


Surrose ie = 4, ue = 3, M = 4 and C = 3. Consider the 


Fight sukvector {2,1,0,1}. Since the sum of the components 
meeche right subvector is equal to N - C, the blocking 
Subvector may take on nontrivial values. The shortened 
blcocking sukvector has three components whose values 
indicate whether or not PP1, P22, and PP4, respectively, are 
Dlocked. A value {1,0,1} indicates that PP1 and PP4Y are 
blocked but EP2 is not. The following table lists the 
feasible (full) blocking subvectors in lexicographic order 


and the numker which would be stored to represent each one. 


rocking stored 

subvector number 
1020,0;, 0 0 
OO 20,01 1 
G10 ,.0 10 
OF 0,. I ad 
0, 071 101 
ie, 0, 0 110 
dept O° 1s 111 


Note that the third component of the blocking subvector is 
Z€cro since tke third component of the right subvector is 
Mero, i.2¢., PP3 cannot be blocked since it is idle. Also 
note that there are 2 = 8 feasitle blocking subvectcrs and 


that their ccrresronding stored numbers are the Dinary 


2c 





B) 
Bepresentaticns of the integers 0,1,2,...,7 = 2 - 1. This 
is because three is the number of nonzero components in the 


right sukvectcr. 


As remarked above, the blocking subvectors need not 
be stored. In fact, since the total number of jobs at the 
Pepe's May not te smaller than N - C, the size of KSTG can 
usually ke reduced, Seguential generation of the states is 
accomplished by successively setting the right subvectcr to 
the values indicated in KSTG, for each right subvector 
successively setting the left subvector to the feasible 
values frcm LSTG, and for each left supvector successively 
setting the blocking subvector to its feasikle values. MThis 
last stef is accompiished (in those cases in which blocking 
is possible) by successively setting the blocking subvector 


egual to the binary representation of the integers from zero 
mn 
to (2 - 1) where mis the largest feasible number of 


biccked EFF's. 


Varicus cptions are available for determining state 
numbers frem vector representations. First, note tnat the 
humber of states corresponding to a given right subvector is 
equal to the number of lert subvectors valid for that right 


Sukvector if the sum of the components of the right 
s e * a ® 
Subvector is larger than N - C; it is equal to 2 times the 


humber of valid left subvectors (where m is the number of 
nonzero ccmpcnents in the right subvector) if this sum 


meats N - Cc. 


One procedure would be to store in NSTG4(1) the 
number of states preceding the first state having KSTG(1) as 
Bes Cight sukvector. A straightforward algorithmic 


precedure (see Algorithm 10 in Appendix B) could then te 
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used to determine tne state number from the vector 
representaticn. Of course, NSTG4Y can be shortened since the 
Number of states having a given right subvector can be 
determined frceom NSTG2 and NSTG3 if the sum of the compcnents 
of the right subvector is larger than N - Cc. It can be 
shortened further if the states are sequenced according toa 
lexicographic ordering of a new vector representation, say 
merarems, which is similar to the ISTATEm2 (or ISTATEn1) 
vector representation except that the number cf nonzero 
cemponents of the right subvector is inserted (as an 
additional ccmponent) Lcetween the first two components, 
1.€., betweer the sum of the components of the right 
Ssukvectcr and the right subvector itself. Since the 
techingues that would be used in this case are sinilar to 
these develored eariier in this section, we will not discuss 


the ISTATEn3 vector representation further. 


3.9. Bulking 


A review of subsection 2.7 reveals that the possible 
values of components add to the vector Lepresentation to 
handle bulking depends upon both right and left subvectors. 
Hence, the prcecedures reguired for sequential generaticn of 
the states and determination of state numbers from vector 
representaticns are those discussed in subsection 3.7 for 


handling nonexponential service distributions. 


G4. GENERATICN AND STORAGE OF THE BALANCE EQUATIONS 


Once the states nave peen appropriately sequenced and an 
Meetezent Ccmputational procedure has been developed tc 
translate state vectors into state numbers, the balance 


eguations may be generated and stored for subsequent 





Meron. Fcri= i, 2, ..., NSTATE, let p_ be the 
i 


steady~stateé probability tnat the system is in state i. 


Then the i-th balance eguation has the form 


(2.2) fedte Of transition from State i) p = 
al 


Ma coe On ebanSsitiloOn FLOM J tO 1) p- 
J 


meyvranng (2.2) through by (rate of transition from state i), 
the balance equaticns can be written in more compact matrix 


form as 

(2.3) P = AP 

Mmere P is the column vector (Pp ,P g4-s¢7P ) and A is 
1 iz Noe aes 


Moe Matrix with (rate of transition from j to 1) divided by 


Seeme Of transiticn from i) at the intersection of the i-th 


Beweand j-th column. 


AS will te seen shortly, A is often a very sparse ratrix 
(2-¢e., a large proportion cf its elements are zeros). 
Memce, it is inefficient to store A in matrix form. Rather 
it is suggested that only its nonzero elements and the 
lecation cf €ach be stored. This is accomplished by storing 


(1) the k-th nonzero element in COEF (k) ; 
fil) the column number for the k-th nonzero 
element in INDEX (k); and 
(247i) the number of nonzero elements in the first 
iercws in NCON(i). 


HAUS, equivalent to (2.2) is 
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24 =e) COEF (7 
(2.4) ES 2 (0) Ps ypEx (5) 
J=MN 


where MN = NCCN(i-1) + 1 (MN = 1 if i = 1) and MX = NCCN(i). 


Generaticn of the balance equations now involves filling 
in the three arrays COEF, INDEX and NCON. To do this the 
following must be determined for each state i: 

Oy the rate cf transition from state i; 

(ii) the varicus states from which the system can 

transiticn (in one step) into state i; and 

(111) the rate of transition from each cf these 

States into state i. 
The rate cf transition from state 1 (hereafter called 
DIVRAT) is the sum of the service rates of the jobs in 
Service at tké various processors. The states from which 
the system can transition into state 1 may be determined 
from the ISTATE vector representation of state i by 
determining which job (or jobs) could have moved in Such a 
Mens iticn. The rate of transition in each such case is the 


service rate cf the job which moved. 
4.1. Key Example 


Since all processors are FCFS, in order for a jcb to 
be a candidate for movement during a transition into state 
meett Must be the leftmost job in the ISTATE listing of jobs 


at some processor. 


Beampie 2.20 


Bere N = 3, N = 4, and M= 2. For state 1 suppcse 
1 @ 
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Sem = (1,1,2,2,1,2¢2,3,3}- Then there is a type-two job 


in service at each of the three processors. Hence, DIVRAT = 
mprez, |) + RATE(2,2) + RATE (2,3). (See Subsection 1.1 for 
definiticn of RATE and ALFA.) There are four states fron 
which the system could transition into state i: 

(1) Frem state J, With ISTATE = 


Me 2, 2, 1,2227374} by a type-two job at PP2 


completing service and proceding to the CPU. Rate 


of transition fron 4, emt Vs eral ek (2, 2) . 
(11) Frcem state J, Woe Deon ois, = 
Ml, 27 2e2,1,2,%4,3} DY a type-two job at PP 


completing service and proceding to the CPU. Rate 


ee transition from i, Reman Seka. Ee (2, 1). 
(111) Frem state ae with ISTATE = 
mum ll, 2,2,2, 5,2} DY a type-two job at the CPU 


completing service and proceding to PP2. Rate of 
transiticn fron fig toe. 3S | RAveriee 3) ALP a2 02) 


{iv) Frem state J, with ISTATE = 
me 2, |lg2,27 42,3} bY a type-one jop at the CPU 


completing service and proceding to PP1. Rate of 
meansiticn from ly COmeaIS RATE (1 sop ALEA (17 1)% 


Metting MN = NCON(i-1) + 1, set: 


COEF (MN) = RATE(2,2) /DIVRAT INDEX (MN) = oF 
COEF (MN+1) = RATE(2,1) /DIVRAT INDEX(MN+1) = a5 
COEF(MN+2) = RATE(2,3) ALFA(2,2)/DIVRAT INDZX(MN+2) = i, 
COEF(MN+3) = RATE (1,3) ALPA (1,1) /DIVRAT INDEX (MN+3) = I, 


3 





NCON(i) = MN + 3 


Meee that the actual values of i, I. i, J, and j may be 


derived frem (2.1) and the respective ISTATE vector 


representaticns. This example should be used as a guide in 
understanding the following examples which develop the 
balance 2guation for a Similar state i for various 


generalizaticns of the key example. 
4.2. Generalization of the Number of 


Exactly the same procedures are followed if the 


nuober of job types is increased beyond two. 


4.3. Generalization of the 


Exanple 2.21 


Consider the same Situation as Example 2.20 excert 
that PP1 iS a multiserver queue with two servers. Then 
Since twc jorks are in service at PP1, DIVRAT has a different 
value: 

DIVRAT = RATE(1,1) + RATE(2,1) + RATE(2,2) + RATE (2,3) 
There will also be some change in the balance equation. Of 
the four tergas listed in Example 2.20, all but (11) are 
Still valid. In the present case it is possible to 
transiticn into state i from either of the to states [Ly 
having a type-twe job complete service at PP1 and route to 
the CPU. Thus, (11) should be replaced by: 

(11) Frcem state i, with ISTATE = 


mien 2, 2,2,1,2,4,3} by a type-two job at PP! 


Someleting service and proceding to the CPU. Rate 
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Se transition from 3 Pome os RADE (Ce 4d) Kee 
(ii') Frem state J with ISTATE = 
mie, 1, 2e2e'72,4,3} DY a type-two job at PP! 


completing service and proceding to the CPU. Rate 


or transition fron Jor wo 1 1S RATE(2,1). 


4.4. Generalization of Queuing Discipline 


With the exception of PS a change of gueuing 
discipline at one or more of the processors would not effect 
the value cf LIVRAT. However, any such change will cause 
Changes in the balance equations. In the following examples 
the Same situation as that examined in Example 2.20 is 
considered with the exception of the gueuing discipline 
change nected in each case. The resulting changes to the 


balance equaticn fcr state i are listed. 


Example 2.22 


Suppose that the gueuing discipline at PP2 is LCFS. 
Then any job arriving at PP2 (from the CPU) will join the 
meen. Of the line rather than the back as in the FCFS 
Meeecipline. Thus {111) should be changed to: 

(111) Frenm state J, With [STALE = 


fel, 2,2,2,2,1,3,2} by a type-one job at the CPU 


Gomcleting service and proceding to PP2. Rate of 
transiticn from J, POL tsenntot!,3)ALRFA(1, 2). 


aie 





Example 2.23 


Suppose that type-one jobs have (nonpreemptive) 
PetrOrity OVer type-two jobs at PP2. Then, if a type-one job 
were to ccmplete service at the CPU and procede to PP2 ata 
time when one cr more type-two jobs were enqueued at PP2, 
the type-cne job wculd enter the line in front of all 
(engueued) type-two jobs. Thus, in addition to the four 
terms listed in Example 2,20, the balance equation in this 
case would have: 

(v) Frenm state J. With ISTATE = 


Mig 2,sls,2e¢2, 1,372} DY A type-one job at the CPU 


completing service and proceding to PP2. Rate of 
meansiticn from J. POM we LSeRALTE (155) ALFA (1,2) ; 


Example z.24 


Suppose that type-two joos have preemptive priority 
Over type-one jobs at FP?. Then, though a newly arriving 
type-two job (at PP1) would not interrupt another type-two 
job in service, it would interrupt a type-one job in 
Service. Hence, tc the four terms listed in Example 2.20 
add; 

(v) Frem state - Whee bStATE = 


mez \,2,252,2,3} DY a type-two job at the CPU 


Completing service and proceding to PP1. Rate of 


transiticn fron He tO ls RAD C2), 3 eae a G2 ll. 


Beample 2.25 


Suppose that the queuing discipline at PP2 is LC&SPR 
BEeLCFSPRet. Then, in contrast to Example 2.22, (111) of 
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Example 2.20 must be changed to: 
foi) From state a with ISTATE = 


Mpls 2,27 le2e223,2} by a type-two job at the CPU 


completing service and proceding to PP2. Rate of 
meansiticn from JF omit SweRALTOC (2,3) ALFA(2, 2). 


Both LCFSPR and LCFSPRpt will be discussed in conjuction 


With generalized Erlangian service distributions. 


Example 2.26 


Suppose that the gueuing discipline at PP1 is PS. 
Then, the value or DIVRAT nust be changed by replacing the 
first term (which is RATE(2,1); see Example 2.20) to 
Mey 2X RATE (1,1) + RATE(2,1) ]. Similarly, since the rate 


Seetkransiticr fron J, to 1 now depends upon the full 
complement of jobs at PP1 just prior to the transition, this 


Tate must cre changed to RATE (2,1) /2. 


4.5. Generalization of Service Distributions 





~~ 


Example z.27 


Suppose that the situation is the same as that in 
Example 2.20 except that jobs at PP2 have ncnexponential 
service distributicns. Wore specifically suppose tnat type- 
one jobs have a service distribution which can be modelled 
as three expcnential stages and that type-two jobs havé one 
Which can be modelied as two exponential stages. Let 
RATE(1,2,k) te the rate parameter for the k-th stage of the 
Meetribution for type-i jobs (k = 1,2,3 if 1 = 1 and k = 1,2 


meer = 2) and let B(i,2,k) be the probability of a type-i 
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job routing to the CPU immediately after completing Stage x 
Meemeerece at PEF2 (k = 1,2 1f 1 =1 and k = 14f i= 2). #£=‘Expand 
the ISTATE vector by one component on the right to indicate 
the stage of service for the job in service at PP2. Suppose 
that in state i, the jceb in service at PP2 is in its second 
stage of service. Then, for state i ISTATE = 
Mty2,2,le2,2,3,3,2} and the second term in the calculation 
of DIVRAT beccmes RATE(2,2,2). In the generation of the 


balance eguaticn the ISTATE vectors for Joe J, and j must 
u 
have the additional component, with value 2, added on the 


right. Since the job in service must have passed through 
stage one, (1) must be changed to: 
(1) Frem state J, With ISTATE = 


Mele 2, 2, 1,2¢2,373,1} by a type-two job at PP2 


completing service and proceding to the second 
stage cf service at PP2. Rate of transition fron 
J, memos RATe( 2,2, 1) ( 1-B(2,2, 1) }. 


If, on the cther hand, the job in service at PP2 in 
Meteo ft iS ir its first stage of service, then ISTATE = 
Mure 2, 1,2,273¢53,1} Lor state 1 and RATE(2,2,1) 1s the 
second term in the calculation of DIVRAT. Again (11), (ii11) 
mma (2¥) are aS in Example 2.20 except that the ISTATE 
vectors have an additicnal ccmponent on the right side, this 
time containing a 1. However, in this case it is possible 
to transiticn into state 1 by having a job complete service 
at PP2 and route to the CPU. In fact, since type-two jobs 
at PP2 can ccmplete service with either of two stages, there 
are two different states from which this can occur. 
Specifically, (i) can be replaced by: 

(1) Frem state a, With ISTATE = 


Peete? 2, 3,4,2} Dy a type-two job at PP2 
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completing service and proceding to the CPU. Rate 
See transiticn fron J, meee ts RATE (2) 2 72). 


(2') Frem state J with ISTATE = 
mile sls le 2¢2-3,4,1} Dy a type-two job at PP2 


completing service and proceding to the CPU. Rate 


of transition fron iF. eC 22s 


Bame (2,2,1)B(2,2,1)- 


Example 2.28 


Suppose that the situation is as described in the 
Mest PadLagracrh of Example 2.27 except that PP2 has LCFSPR 
gueuing discipline. Then as discussed in subsection 2.4, 
to tne ISTATE vectcr representation of each state must be 
added N = 7 ccmponents to represent the stage of service 
€ach job was in when it last received service (or is 
currently in if it is receiving service). Suppose that the 
type-two job engueued at PP2 was in its second stage and the 
mype-one job in its third stage. Then, for state i, ISTATE 
Mel 2, 2, ly dg ee3r de lsgteg leg de3ee,1} Mhere the ones for jops 
not at PF2 are default vaiues. DIVRAT is as descrited in 
the first paragraph of Sxample 2.27. The terms of the 
balance eguation are determined by considering transitions 
mateo State i. 

(1) From state ny Veer ota TE == 


Me ole 2 pe 3, 4, 1,1, \¢2e3e272} bY a type-two 


job at EF2 completing service and proceding to the 


Meu. Rate of transition from a tc i is 


MATE (2,2,2). 


aks, 





om) Frcem state ae With ISTATE = 
Mn, 27 bp 2p 2¢ 5, 4,1, 1, 1,2,372,1} by a type-two 


job at FF2 completing service and proceding to the 


CPU. Rate of transition fron ae POLS oS 

femme (2,2,1)B(2,2,1)- 

(i1) Frem state iF With ISTATE = 

mugs 2, 2,2, 1,2,0,3, 1, 1,1,1,2,3,2} by a type-two 


job at FF1 ccmpleting service and proceding to the 


O20. Rate of transition fron 1, Ver lesS 

bye (z,1). 

(iii) Frem state a Deen lowe A te a= 

Mme 2, ly 2, 2,353,353, 1), lg le 2e3ert,1} bY a type-tKo 


job at EFF2 completing service and proceeding to the 
second stage cf service at PP2. Rate of 


transiticn from I, 2G) 3 as 

mmpe (2,2, 1){ i-B(2,2,1) ]. 

(lv) Frcem state I, wilt Qe AE, = 
Mere cl, 2,5, ly 1, 273,72, 1,1} Dy a type-one 


job at the CPU completing service and froceding tc 


PPT. Rate of transition from j toi is 
4 
RATE (1,3) ALFA (1,1). 


Note that a transition such as that described in (111) cf 
EXample 2.20 is not possible Since any job arriving at PP2 


wculd immediately enter the first stage of service there. 
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mPeample 2.29 


Suerose that the Situation is as in the first 
Datagraph of Example 2.27 except that the gueuing 
discipline at PP2 is LCFSPRpt. Then, N + 1 = 8 components 
must be added to each ISTATE vector. The first seven of 
these represent the largest stage of service attained at PP2 
by the various jobs Since last departing from PP2. (Again 
one is used as a default value.) The last ccmponent is used 
to indicate the current stage of the job in service at PP2. 
Suppose that the largest stage attained by the type-twce job 
engueued at FPZ was twe and by the type-one job enqueued 
there was three. Suppose that the job in service at PP2 had 
attained the second stage put was interrupted there and is 
currently in the first stage of service. Then, for state i 
een l, 142,27 lp 2p 2e3e 30 le lolete deere i, 13+ DIVRALT is as 
described in the second paragraph of Example 2.27. The 
terms of the balance €quation (compare with Example 2.28) 
are obtained ky considering transitions into state i: 

(i) Frem state i With ISTATE = 


Memes 2, le 27 2,3,4,1,1,1,2,3,2,2,13} by a type-two 


job at EP2 compieting service and proceding to the 


CPU. Rate cf transition fron 1 cGel 1s 
meen(2,2z,1)B(2,2,1). 

(i') Frem state je with ISTATE = 

penne 12 2,3, 4,1, 17 122r5727 1,1} by a type-two 


job at EP2 completing service and proceding to the 


CPU. Rate of transition from ey, EO. i iS 


emer i2,2,1)B(2,2,1). 
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(2") Frcm state ag Wie ho LA PS = 
ly typ te fe 1 ¢ 2, 2¢3¢4,1,1,142,342,2,2} by a type-two 


job at FF2 completing service and proceding to the 


CPU. Rate of transition from Se coe 1s 

Pepe ({2_.2,2) » 

(4a) Frem state 1, ion eLSGATE = 

{Ve ledeg ce 2a lg 24,3, 14615 161,2¢3,2,1} by a type-two 


Job at FF1 completing service and proceding to the 


@e0. Rate of transition fron J, LO Vy ab, = BUS 

mati (zc, 1). 

(iii) Frem state 1, itch PS Dae es 

Mee 1, Ze Ze 162, 3,1,-1,2,3,221,1,13 by a tvype~-one 


job at the CPU completing service and froceding tc 


Pel. Rate of transition fron ah EOua 25 


RATE (1,=) ALFA (t,1). 


MeO. Finite Capacities and Blocking 


= a ee Se SS == [SS ae 


Example 2.39 


Suppose that the situation 1S aS in Example 2.20 
except that FP2 has a capacity of three jobs. Then to the 
ISTATE vectcr for each state add one additicnal component 
Which takes cn the value zero if the CPU is not blocked and 
two if it is Elocked (by a job which has completed service 
at the CPU but found PP2 at capacity when it tried to route 
Where). Finally suppose that in state i the CPU is not 
Mepmerrea sc that ISTATE = {1,1,2,2,1,2,2,3,3,0}. DIVRAI has 
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exactly that value specified in Example 2.20. (If the CPU 
were blocked, DIVRAT would be RATE(2,1) + RATE(2,2).) 
Turning new to the balance equation, the last three terms as 
specified in Fxample 2.20 are still valid with the addition 
of a zero-valued component to the right end cf the ISTATE 


vector for states sy J and Je The capacity of PP2 makes 


state j ilmpcssible. However, if the last enqueued jor at 
PP2 in state J, were instead blocking the CPU, a transition 
of the type described in (i) of Example 2.20 would cause 


Simultaneous poevement of this job to PP2 and result in state 
feeeinat 1s, (1) can be replaced by: 
(1) Erem state J. With ISTATE = 


mes lg2s2¢2e3e3-2} Dy a type-two job at PP2 


completing service and proceding to the CPU and 
Simultaneous movement of a type-two job from the 
Meu tO FEF2, unblocking the CPU. Rate of 


transiticn from ‘i. oe eee Seren ha 92) ts 


4.7. Buiking 


Ee <@ 42 a oe 


Example 2.31 


Suppose that the situation is as Example 2.20 except 
that type~cne jobs destined for PP1 bulk at the CPU and 
Meeet Only in pairs. Then, to the ISTATE vector for each 
State add one additicnal component which indicates the 
number of tyre-one jobs in the bulking queue at CPU. 
Mummies ror state i, ISTATE = {1,1,2,2,1,2,72,3,3,9}.- 

DIVRAT and the first three terms of the balance eguaticn are 
(With the cbvicus change to the appropriate ISTATE vectors) 


@s indicated in Example 2.20. In fact, even (iv) is correct 
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memene ISTATE vectcr for J, 1s changed to 
Meee 2,2, 1, 1,1,3,1} and the wording is changed slightly to 


indicate that two type-one jobs proceed to PP1. 


See eOrERTIES OF THs SYSTEM OF EALANCE EQUATIONS 


In this chapter concepts and téchnigues designed tc aid 
in the scluticn of the variety of queuing network problems 
have been introduced. Many of these problems do not satisfy 
local balance and therefore are generally not known to have 
Sitgple clcsed~form solutions, such as the product~forn 
solutions. More specifically, this chapter has been 
ccncerned with hcew to conveniently specify, arrange and 
store the states of such problems and now to generate the 
balance e€quaticns. Solution of these balance equations is 


the subject of the next chapter. 


The apprcach has been to introduce the concepts and 
technigues with a view toward eventual implementation cn 
high-speed digital computers. The reason is simply that the 
size of the problems encountered in modeling even simple 
Systems is very large. For example, the case considered in 
Example 2.20, two types of jobs with three jcbs of one type 
mm@emtour ci the other circulating in a central-server model 
consisting of a FCFS single~server CPU and two FCFS single- 
Server PP's, yields 1260 states and 3920 nonzero entries in 
Mme tChansiticn matrix. Incr¢éasing the numker of PP's to 
four increases the state space to 11,550 and the number of 


hcenzero é€ntries to 58,800. 
Some of the generalizations discussed in this chapter 


Bill decrease the state space and others will increase it. 


fOr example, giving a PS queuing discipline cr nultipie 
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servers tc a queue tends to decrease the state space. On 
the other hand, the state space will be increased by 
introduction cf mcre job types (even though the total number 
of jobs remains unchanged) or by any generalization which 
increases the size of the ISTATE vector, for example, 
blecking, bulking, most preemptive queuing disciplines and 


generalized Erlangian service distributions. 


Aside frcem potentially massive size, an important 
feature of these problems 1s the sparseness of the 
transiticn matrix. This is seen in the examples in section 
4 where the maximum number of nonzero entries in each row is 
seen to be arcund four or five no matter what the number of 
states is. Two measures of sparseness are the average 
Number cf ncrzero entries per row of the matrix (3920/1260 = 
3.1 and 58,8C0/11,550 = 5.1 for the examples above) and the 


2 
proporticn cf nonzero entries in the matrix (3920/(1260) = 
Z 
-0025 and 58,800/ (11,550) = .00044 for the examples 


above). 


In the opening section of this chapter it was hinted 
that the techniques introduced here could be applied tc a 
more general class of networks than the central-server model 
for which they were introduced. Doing so will increase the 
Sparseness measures (i.e., increase the number of terms in 
the balance equations) without affecting the size of the 
State space. The more specific setting of the central- 
Ss€tver models was used here to simplify the presentation and 
because cf the applicability of the central-server models to 


modelling cf ccmputer systems. 
mamacditicn, scme of the other properties of the 


central-server models allow analysis which may not be 


Meesible in ucre ccmplex models. For exaaple, a central- 
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server mcdéel with two job types and at least two PP's is 
guaranteed to be irreducible. If, in addition, all service 
distributions are exponential, the resulting Markov chain 
can be shecwn to be periodic of order two. These two facts 


are proved in Appendix C. 


The technigues discussed in this chapter have been used 
in programming the key exampie and two generalizations for 
use On a high-speed digital computer. The prcgram for the 
key example is given in Appendix D. One generalization 
gives the CPU a PS queuing discipline. This program is 
given in Appendix E. The other generalization retains the 
FCFS discipline at the CPU but has the capability to make 
the CPU a multiserver processor. In addition, one of the 
PP's in this modei has an IS discipline and can accept only 
@@emtype Of job. This program is given in Appendix F. All 


three models are discussed in Chapter IV. 


The fact that these three models are central-server 
models with exponential service times guarantees that they 
@meemarcreducitle and periodic of order two. This periodicity 
is used to advantage in discussing the convergence 
prcperties of the solution methods presented in the next 


Chapter. 
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TII. SOLUTION OF THE BALANCE EQUATIONS 


The gcai cf this chapter is to present a variety of 
precedures suitable for solution of the balance equaticns 
which result frcm application of the concepts and techniques 
discussed in the preceding chapter. In view of the 
properties of these systems of eguations (see section 5 of 
Chapter II), the main concern is determination of a 
precedure which is guaranteed to provide a solution fora 
cyclic mcdel. In addition, a procedure which preserves the 
sparse nature of the system will allow soluticn orf larger 


problems. 


In the first section of this chapter the choice of a 
solution methced is discussed in the iight of these 
considerations. The resulting choice is an iterative 
method. This section also serves as an introduction tc the 
analysis of various solution methods by introducing the 
problem as an eigenvalue/aigenvector problem. The seccnd 
section intrcduces the notation used in the remainder cf the 
Chapter and reviews pertinent matrix terminology and 
theorems. Tke third section examines the eigenstructure of 
he Matrices resulting from some of the central-server 
models discussed in the preceding chapter. Finally, section 
4 is devcted to various iterative solution methods and 
Conditicns under which they are guaranteed tc converge. 
mmrsecticn 4.4 indicates the areas 1n which further research 
May be useful in accelerating the convergence of the method 
ultimately chcsen as preferred for the proplems of interest 
SO the author. 
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meeecHOLTCE OF A SOLUTICN METHOD 


The system of balance eguations discussed in the 
preceding chapter is a system of homogeneous linear 
eguations. This fact is most easily seen to be true from 


equation, (2.3) which is repeated here: 


(3.1) P = AP 


and whick can be rewritten as: 


(3.2) (I - AJP = C 


In these two equations A and I are square n x n matricés 
(where nis the number of states) and P and ( are colurn 
Meecors Of length n; I 1s an identity matrix and all 
components of € are zero. The nonzero elements of A are the 
Rumbers stored in the array COEF as discussed in secticn 4 


of the preceding chapter. 


(Since tlé primary references in this chapter are Erooks 
On numerical analysis, the numerical analysts' emphasis on 
column vectors, rather than the probabilists' emphasis on 
TCw vectors, is adhered to here. As will be seen in section 
3, Our expression of the problem is the transpose of that 
hormally adopted by the probabalists. Hence, with due 
apology tec these who may be confused, we assure the reader 
that we are investigating the forward equations {see Feller 
mee}, Chapter XIV, section 7) and not the backward equations 


aS it may at first appear.) 


As a system cf homogeneous linear equations, (3.1) must 
Mave cither an infinite number of solutions cr no solution 
Sreall. Of course, the goal here is to determine a solution 


meee (3.1) which satisfies two other conditions: 
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(3.3) 


{— 
a @) 
il 

_ 


where 1 1s the row vector of length n all of whose 


components are ones, and 
(3.4) mer 2 0 
Mem@atron (3.2) is called a normalizing condition. 


Two cpeticns are open for attacking this probiem. First, 
meezpo and (3.3) could be concatenated and the resulting 
overdeterzined system of linear equations could be solved. 
Obtaining a sclution (hopefully), satisfaction of (3.4) 
could be tested. Second, (3.2) could be viewed as an 
eligenvectcr rroblem and an attempt could be made to find a 
Tight eigenvector cf A, corresponding to the eigenvalue 1, 
Which alsc satisfies (3.4). Normalizing (i.e., dividing the 
eigenvector by the sum of its components) wculd yield tae 
desired result. Extensive literature provides a large 
Variety cf scluticn methods for both the linear equaticn 
problem and the eigenvalue/feigenvector problem. For 
example, see Householder {53] and Wilkinson [111]. Because 
of the structure of the matrix A in (3.1), the j 


eigenvalue/eigenvector approach was selected. 


Whether the linear equation problem or the 
elgenvalueyeigenvector proplem is chosen, the solution 
technigues fall into three categories: direct, iterative, 
and semi-iterative. An iterative method of solving the 
preoblem was chosen. The reason for this choice was 
three-fold. First, the iterative methods are, in general, 
Beeder tc prcgram. Second, there 15 not as great a prcblen 
With tound-cff as there is with the direct methods. (See 
@eeteand McCracken {29}.) Finally, the iterative methcds, 


combined with sparse matrix storage techniques, generally 
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reguire less storage to solve a given problem than do the 
the direct and semi-iterative methods. Many of these latter 
methods use row and column operations on the coefficient 
Matrix. The result is that many of the elements which were 
originally zero are replaced by nonzero elements and 
therefore require storage. This phenomenon is referred to 
meeeecill”® in the literature. In addition, most direct and 
semi-iterative methods require storage of the coerficient 
matrix ina form which is less efficient than that discussed 


Mmesecticn 4 c£ the preceding chapter. 


On the cther hand, the iterative nethods generally 
require icnger running times. This disadvantage is somewhat 
diminished by the fact that the best direct methods take 
time to séarch and rearrange the rows and/or columns of the 
coefficient matrix in an effort to reduce fili and the fact 
that space, and not time, is the constraint in many large 


prcblems. 


For a comprehensive treatment of iterative and 
Semi-iterative methods the reader is referred to Varga [106] 


Meeroung {114}. 


Meee MATRIX PRELIMINARIES 


The netaticn and some of the elementary 
Matrix-theoretical results used in succeeding sections of 
this chapter are discussed in this section. In the first 
subSecticn much of the notation used in this chapter is 
defined. Tke second subsection is devcted to permutation, 
irreducible and cyclic matrices and the final subsecticn, to 


G@igenvalues and eigenvectors. 
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mes NOtation 


wee 


in general, upper case letters at the beginning of 
the alphabet will denote mnatrices, upper case letters at the 
end of the alphabet will denote vectors, and lower case 
letters will denote scalars and functions. If Aisa 
matrix, the element in the i-th row and the j-th column of A 
wili te denoted as Se VaAGrav~ the i-th ccmronent of 
vector X will cre denoted a The statement "A is anm <xo 


Matrix" means that A is a rectangular matrix with m rows and 


n cclumns. The statement "A is a matrix of order n" means 
that A 1s a ¢quare matrix with n rows (and columns). 
Although the interest here lies primarily in the area cf 
Sguare matrices having real elements, many cf the results 
acre also valid for matrices having complex elements, and at 


times rectangular matrices will be dealt with. 


A matrix cr vector is descrived as real, positive, 
nennegative, ccmplex, etc. according to whether its 


elements are real, positive, nonnegative, complex, etc. For 


T * 
any matrix A, A denotes the transpose of A, A denotes the 


Semplex ccnjugate cf A, and, if A iS Square and nonsingular, 


-1 
A is the inverse of A. If X is a vector, t a scalar and f 


T * * -1 * -1 — 
Memeictacn, then XX , X , t,t , £ andt are Similarly 


defined. Whether a vector is a row vector or a column 


vector will usually be clear from the context. 


The fcllowing special notation is used througncut 
this chapter: 


(i) I = the identity matrix (order to be inferred 
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meom context). 
2) i = the identity matrix of order n. 
(iii) ae = the matrix of order n all of whose 
elements are zero. 

~ 


(iv) @ = a matrix (in general, rectangular) all of 


whose elements are Zero. 


(v) © = a null vector = a vector ail of whose 
compcnents are zero. 
(vi) a = Ties 5 ons sip 0} 


the set consisting of the 


merst N positive integers. 


Mreeticlst part Of Definition 3.1 follows that cf 
Halmos [48]. 


Peetritiones. | Let £ be any set. A partiticn of T 


Swe Se ee ee ee —n anaes oop —=EP Ee ae SO 


mea Collection cf nonempty subsets of T, {S }  , such that 
nee BS 

each element cf T is in exactly one S . If J = N_ fcr some 
at n 


positive integer n and T is a set of real numbers, then 


iS } Pamcerbeamanmardered partition af each element of S_ 


me oJ al 


1s smaller than each element of S- i Otoetnse le owe 
1? 


If Ais an m x n matrix, consideration may be given 


Mena Dartiticn of A as: 
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A A ee 

it 1t| 

A A are A 

zi 782 2t| 

5) ys JN A en <A 
31 a Pe o 

{A A sa6%s A | 

s1 Ss2 St 


Mmeees<nc A are (rectangular) matrices called submatrices 
+) 
cf A. Fermalily, this situation may be described by letting 


S ie 
{S } ke an crdered partition cf N and {T } be an 
k k=1 mM k k=1 


@eaered partition cf N. Then, g €S and réT iff a is 
n k h qs 

one of the elements of the submatrix Ny In the cases 

considered here, A will be a square matrix and the 


partitions oe and oe Wiieeoe- leentical., “AS a result, 


the submatrices on the main diagonal will be syuare. 


In a Similar way partitioning a vector into 
subvectors will be considered. If a matrix A is under 
Consideration and has been partitioned as in (3.5), and if a 

st T ah 


it 
vector X = Coe Mu Bes ep a BS Intmoaguced, then X has no 


components ard can be assumed to have been partitioned in 
maen ad Manner that the product A xX is well defined. That 


kh h 


is, the freoduct AX is given by: 
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A xX + ne: ee ae 
| ae hae. ire 
{A xX + tere. te X 
0 a PA Po Po oto 
6) AX = la X + tee Ae Xe | 
| 37 1 S252 Sie act 
foe 8 oe UA XhCUDhlU e+ OCA X 
£ si 1 S82 st td 
ueccw VECtor Y = (¥ , ¥ , «-. , ¥ ) the product YA is 


1 2 Ss 
Sitilarly defined. 


2.2. special Types of Matrices 


= 


Fer background reading on permutaticn matrices, the 
reader is referred to Birkhoff and MacLane [12]. For 
background reading on irreducible matrices, see Varga [106] 
@emroung [114}. For background reading on cyclic 
irreducitle matrices, see Feller {31] or Gaver and Thompson 
{44}. Although Varga has an excellent discussion of cyclic 
irreducitle mratrices, the development here is more closely 
related tc the discussion of periodic states of a Markcv 


mirain as fourd in these other references. 


eae SS SS eee: oe [See oa SS 


€ach or whose elements is either a zero or a one, and each 
Tow of which, and each column of which, contains exactly one 


nenzero element. 


Several facts concerning permutation matrices are 
Meow fisted without proof. Let M be a permutation matrix. 


(1) M is Square and nonsingular. 


_ ob ; 
(11) 4M = M is a permutation matrix. 
(211) Premultiplication of a column vector, or 


Pest@ultiplication of a row vector, by M has the 
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effect of rearranging the components of the 
Wwector. 

(iv) Premultiplication (postmultiplication) of a 
matrix Ey M has the effect of rearranging the 
order of its rows (columns). 


(v) Premuitipiication of a Square matrix, A, by ™ 
= 
and. postmultiplication of the result by ¥# has 


the effect of rearranging the rows and columns of 
A in the same way. If the i-th row and i-th 
Sotumn cf A correspond to a state (e.g., if A is 
SeeeransSition matrix; or if A is a coefficient 
Matrix as described in section 4 of the preceding 
Chapter), then the effect 1S a renumbering of the 
eta ces. 

(vi) The product of M and another permutation 


Matrix results in a permutation matrix. 


Definition 3.3 If M is a permutation matrix of 
order n, the fermutation function associated with Misa 
mametion £ frcoem N to N such that £(1) = j iff m = 1. 

D n ) 


Scmé properties of permutation functions are: 
(1) Ii £f 1s the permutation function associated 
With M, then £ is a well defined, one-to-one, onto 
eunction. 
fer) If £ is the permutation function associated 


=) 
with M, then f is the permutation function 


-] 
assoclated with M . 


fey PROPEEtieS (111), {iv) and (v) of the 
permutation matrix M can be expressed more 
eaplacitiy in terms of the permutation function f 


asscciated with M. For example, if A is a matrix 


i) 3) 





ee crdéer n, and 8 = MAM , then b =a_. 
1) aq 2 (1) 


Moc alliand=jinwN. 
n 


ae ee? ee oe ee ee = ae ep ae ee eee 


Mean? OL if n > 1 and, given any partition {S, T} of N , 
n 


M@gere 1S an iin S$ anda j in T such that a # 0. 
13 


micorem 3.1 Each of the foliowing two conditions is 
equivalent tc irreducibility of a matrix A of order npn: 


{a) There does not exist a permutation matrix M such 


that MAM has the form 


rA B 4 
| 
mo. 7) May = | 
| 3 
| IZ 
where A and a are Square matrices. 
11 ee, 
(b) Either n = 7 or n > 1 and, given any two numbers i 
mae) in K} , €ither a #0 or there exist i, 1, ...,1 
n al) 1 Z S 
mein N such that 
n 
a ce OC # Q 
tt as ieee ee 
e122 s 


Proof of Theorem 3.71 is found in Young [1174]. 


In terms of stochastic mcedelling terminology (see 
reller [31] cr Gaver and Thompson {44]) part (b) of Theorem 
3.1 says that the transition matrix (and the system as well) 
Meeitreducible iff given any two states i and j, it is 
Meesiple tc get from ito j in a finite number or 


m@ransiticns. 
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mieOorsen ince Li A iS a matrix of order n and if for 


—_—_en ewe oe =a aS SS eS 


any two elements, i and j, of N there exists an integer ao 
n 


(pessibly dependent upcn 1 and j) such that the element in 
e e a e 
merit —-th row and j-th column of A is nonzero, then A is 


irreducible. Furthermore, if A is nonnegative, the reverse 


miebicaticn is also true. 


Proof: Both parts are a direct consequence of (b) 


1 
Memesaid tO be cyclic with period k, or k-cyclic, (where k > 


Kk 
Meoeai intecer) if there is a partition, {S}. , of N 
1 1=1 n 
Such that if a # QO, then either 
13 
fe) 1 is in 23 and j is in Phe Ong 
et iS in S and jis in § for some m # 1 in 
m n-1 

ie 

Ma@egeit there is no decomposition of N into k' > k subsets 


Nn 


having this same property. 


hee Anis dek-GCYCLIC MATEIX OF OFder Nn, 


then there is a permutation matrix M such that 


17 





.. 
aS 
G 
ast 
Q 
a 
ae 








A p g coe 6D g 


| 
(3.8) MAM = i A g oe g 
| 





| 
ae | 
| 
B £6 BP .. A g | 
J 


(= 
~~ 


where - + a ne a =n and all of the nonzero elements 


of A are contained in the submatrices ot eee oe 


kK 
Eroof: Let {S }. be the partition cf N provided 
1 i= n 


for in Definition 3.5. Let n. be the number of elements of 
1 


MeecOr i = 1,2,...,k. Put the n elements of N intoa 
a n 


~- 


MeetOol V ci length n such taat the a elements of oe are 
listed first, then the n elements of may and so forth. 


Define a watrix M Ey letting mn» =1if v. = jandm  =090 
13 i 2B 


k 
MenperwWise. Since {S }. 1S a Partition of N , M is a 
i i= n 


permutaticn matrix. Let £ be the permutation function 
associated with M. Note that £(1i) = j7 1ff mm. = 1 i1ff v. = 


1b z 


Mmeernus, £(/3) = v for i = 1,2,...,n. Letting B = MAF 


158 





and using property (i111) of permutation functions, b = 


Ly 
sO fee ouppese Db Ff 0 and i Sin. Then, £(1) = v 
mrt) £ (3) a) 1 Y (2) A 
is in a Pymieoecs Definition 3.5, £(j) = v. is in a So 


meat Nn ~ an Qe ooleeecndt 1S, Db must be in a The 
1) 


remainder of the theorem foliows through similar use of (b) 


meeepertiniticr 3.5. 


The matrix on the right side of (3.8) illustrates 
what will hereafter be cailed the first canonical form for a 
kK-cyclic matrix. Companion to this is a second cancnical 
form which has all of its nonzero elements in the 
Sukmatrices immediately above the main diagenal matrices and 
in the sukmatrix in the lower lert hand corner. This second 
canonical form will not be discussed in this thesis. Note 
that these twce forms coincide 1£ k = 2. Hereafter, the 
meeceement "A is a k-cyclic matrix of order n in first 
Seamontcail form’ will imply that A is an irreducible matrix 


WHich satisfies (3.8) with M =TI. 
n 


In the case that the period of the irreducible 
Matrix A is two, a third canonical form is also of interest. 
The statement "A is a cyclic irreducible matrix of order na 
in third cancnical form" will imply that the period of A is 


myo and there is an integer k (2 < k S$ n) such that 








n IZ 
1 
A eee 
{ 21 “ 75: “ 4 ‘ | 
| 2 
| 
3.9 A = A ee 6 
(3-9) p ag a 4 B | 
| | 
! { 
#ee#eesesee#¢?# Gila Pehedele. e] oles Je(6)is)/e ae) ai/s)0' swe. «: se} 
P @ g i) . r 
| Kika n | 
L kJ 
where - wee of eee + ue =n. An example of a Markov chain 
Z 


transition matrix exhibiting this form is provided in Feller 


[31], chapter XV, section 2, example (e) where the Ehrenfest 
mcdel of diffusion is discussed. In this example k = n. If 
mee, the third canonical form coincides with the first and 
secend. 


mee Higenvalues and Eigenvectors 


ee ee ee ee ae ee = > a == —— Ss cE OME ce 


Fer Eackground reading on the subject of this 
subsecticn, the reader is referred to Wilkinson [111]. 


Throughout this subsection A is a matrix of order n. 


a 


Definition 3.6 The complex number t is an 


— oe ee eS ses 


Bigenvalue of A if the matrix (A - ti ) is singular. fhe 
n 


— aoe 


polynomial f(t) = det(A - tI ) is called the characteristic 
n 
pclynomial of A. If t is an eigenvalue of A, then any 


nonnuli vector X satisfying the equation: 


fs 10) XA = tX (or equivalently, X(A - tI) = Q 
n 
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Mewa Left eigenvector of A corresponding to t, and any 


nonnull eigenvector ¥ satisfying: 


2.11) AY = tY (oes equivalently, (A = ti }Y = 0 
n 


is a Eight eigenvector of A corresponding to t. 


The following are properties of eigenvalues and 
eigenvectcrs. Although in most cases similar statements 
hold for left eigenvectors, the properties and theorems of 
this subsection will be stated in terms of right 
elgenvectcrs cnly. 

(1) The eligenvaiues of A are the roots cf f(t) = 0 
where £(t) is the characteristic polynomial of A. 
Hence, there are at most n distinct eigenvalues. 
(11) Corresponding to each eigenvalue cf A there 
1s at least one right eigenvector. 

(Lii) Any linear combination of right eigenvectors 
of A corresponding to a given eigenvalue is also 
an eigenvector of A corresponding to that 
€ilgenvalue. In particular, any (nonzero) scalar 
Mircaple of a Fright eigenvector is also a right 
eigenvector. 

ory) If ic Eo? EA; as are distinct eigenvalues 
mea and, for each 1 = 1,2,...,k, SF PS de ragat 


eigenvector cf A corresponding to t , then the 
al 


vectcrs ae Le wee, X are linearly independent. 


my if t is an eigenvalue of A and X is a rignt 
eigenvector of A corresponding to t, then t 1S an 


ae it 
€igenvalue of A , X is a left eigenvector of A 


* 
correspcnding to t, t is an eigenvalue of A , and 
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* * 
fees a Light eigenvector of A corresponding to 


xe 
ie 
(vi) If A is real, then t is an eigenvalue of A 
x 
iff t is an e€igenvalue of A. 
e e e e e Al 
mee) It A is real and symmetric {i.e., A = A), 


then ali of the eigenvalues of A are real. 


Theorem 3.4 Let t be an eigenvalue cf A and let X 

be a right eigenvector of A corresponding te t. Then for 

Mayenonsingular matrix 3B of crder n, t is an eigenvalue of 
= 4 ~4 

BAB and BX is a Fight eigenvector of BAB corresponding 


Bo tt. 


PeoOt>s olnce X is a right eigenvector of A 


Corresponding to t, tX = AX. Hence, tBX = B(tX) = B(AX) = 


-1 
mat X) = (EAE ) (EX). 
nN 


Of particular interest in Theorem 3.4 is the case in 

Which B is a permutation matrix. In that case (see preperty 
-1 

(111) of permutation matrices), the eigenvectors of BAB 
are identicai to those of A except that the crder of the 
components are rearranged in a manner which can be specified 
in terms cf the permutation fuaction associated with B. [In 
View of property (v) of permutation matrices, Theorem 3.4 
indicates the effect of renumbering the states on the 
elgenvalues and eigenvectors of the transition cr rate 


Matrix of a Markov chain. 


The following theorem is stated without proof since 


the proof is a simple verification. 
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miPoreimewImebet A De a K>-cyclic matrix of ordér n 


in first cancnical form. Then t is an eigenvalue of A and X 
ah 
is a right eigenvector of A corresponding tc t, where X = 


ie oT T mA 
Bet! : | f athe 


12) tx = 


Ho 
os 
J. 
Fh 
=) 
il 


ep ieee 


Returning to eguation (3.2), it is seen that the 
eigenvalue/eigenvector problem alluded to in section 1 is 
determinaticn of a right eigenvector of the coefficient 
matrix A corresponding to tne eigenvalue 1. As indicated in 
the next section, Perron-Frobenius theory prcvides 
guarantees tkat 11S an eigenvalue and that a right 
eigenvector cf A corresponding to the eigenvalue 1 exists 


Which alsc satisfies (3.4). 


SeeeiGENSTROCIURE OF THE CENTRAL SERVER MODELS 


Before ccnsidering the solution methods to be discussed 
in the next section, it is helpful to know something aktout 
the eigenvalues and eigenvectors of the coefficient matrix A 
Of equaticn (3.1). Recall that the objective is to fird a 
Cight eigenvector cf A corresponding to an eigenvalue cf one 
mm@@esatisfying both (3.3) and (3.4). The first questicn 
Should be, “Is one an eigenvalue of A?" Then, "Is there a 
nonnegative right eigenvector of A corresponding to one?" 

If so, property (iii) of eigenvalues and eigenvectors 
guarantees that it can be normalized (i.¢., divided by the 
Sum of its ccmponents) and, thereby, one can be found which 


Satisfies (3.3) as well. Recalling the definition of F as 
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the steady-state probability distribution for the systen, 
the next guestion should be, "Is this right eigenvector of A 
correspoading to one and satisfying (3.3) and (3.4) unigue 


With respect tc these properties?" 


Note that these three yuestions are exactly those which 
are answered by the standard theorems concerning existence 
@eeadn invariant distribution for an irreducible Markov chain 
with only persistent states. (See Feller [31], Chapter XV, 
sections 7 and 9.) Despite the fact that A is not a 
transiticn matrix (indeed, A is neither row nor column 
stcchastic), this approach can be taken. Defining an n x n 
Matrix R whose i-th main diagonal element is the rate cf 
transiticn frem state 1 (given the system is in state i) for 


1 = 1,2,...,n and whose nondiagonal elements are all zeros, 


then C = RAR is column stochastic and (3.1) can be 


rewritter as: 


iy 
(3.13) Q = CQ 


Where Q = RP. The Markov chain theory cited above provides 
the existence of a unigue probability vector Q satisfying 
(3.13) if the appropriate hypotheses are satisfied. This 
result can then be translated into a result concerning 
(3.1). The reader is referred to Feller [32], Chapter XIV, 
Seetion 7 on applications of Laplace transforms. If the 
limit is taken in Feller's (7.19) as the transformation 
Variable aprroaches zero, the result is the transpose cf 
(3.13) abcve. 


As an alternative to tnis approach the results of 
Perron-Frobenius theory will be used here. At the same time 
the eigenstructure of A and C will be investigated further. 
Our primary reference for this section is Seneta [99]. Otaer 


references are Varga j; 106] and Young [114]. 
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The following theorem contains many of the impcrtant 
results of the Perron-Frobenius theory of finite nonnegative 
Matrices. Its proof is found in Seneta [99] from which its 


contents were extracted. 


Theorer 3.6 Suppose T is an na x n irreducible 
ncennegative matrix. Then there exists an eigenvalue r of T 
soch that: 

(1) rcv is real and positive; 

(11) there are strictly positive left and rignat 

elgenvectcrs cf T corresponding to 1; 

(111) the eigenvectors cf T corresponding to r are 

unigue up to constant nultiples; 

My) tis a Simple root of the characteristic 

madaticn of T; 

(v) coc 2 {tj if t is any other eigenvalue of T; 

my af T 2s k-cyclic, then T has exactly k 


eigenvalues t such that [t] = r and these k 


eigenvalues are the roots of the equation 
k K 
mes F = 0; 


memieat £ iS nct cyclic, then r > |t|] 18 t#e 
and t is an eigenvalue of T; 


med) if Ss 15 the sum of the elements of the 


Mio crew of FT and c is the sum of the elements of 
a 


mfominm th Golumn of T {for 1 = 1,2,.-+-6,n), then 


(3.174) Mine ces er < fax S and Min ¢, S £ S max C_ 
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The cigenvalue r referred to in Thecrem 3.6 is 
called the Perron-Frobenius €igenvalue of T, and the right 
and left sigenvectors corresponging to r are called 


Perron-Frebenius eigenvectors. 


A quick review of the early part of section 4 of the 
preceding charter reveals that A is a nonnegative matrix. 
As indicated in Appendix C, for many models this matrix is 
irreducible (though perhaps cyclic). Hence, Theorem 3.6 
applies in these cases. If the Perron-Frobenius eigenvalue 
of A were kncwn to have value 1, the three questions pcsed 
at the beginring of this section would all be answered 


Moeedtively by (1), (11) and (111) of Theorem 3.6. 


Consider now the matrix C defined above and 

appearing in (3.13). Since premultiplication of A by & and 
=) 

Bosctmultirlication by & has the effect of, respectively, 
Multiplying each element in the i-th row by the rate of 
transiticn frcm state i and dividing each element of the 
i-th column Ly this same (positive) number, C is also 
Meecducitie {and cyclic). But C is column stochastic. So, 


part (viii) cf Theorem 3.6 indicates that r = 11s the 


Perron-Frobenius eigenvalue of C. By Theorem 3.4, A = 


-1 
R CR has the same eigenvalues as C. The conclusion is that 


the Perrcn-Frobenius eigenvalue of Ais r = 1. Note furtner 
that part (v) of Theorem 3.6 provides assurance that the 
Perron-Frobenius eigenvalue is, in some sense, dominant 
amcng the eigenvalues cf A. This fact will become impcrtant 
an the discussicn of the soluticn metnods in the next 
Section. First, however, it is advantageous to examine more 


Closely the eigenvalues and eigenvectors of A. 
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er 2 - macioceuceure Of a k-cyclic Matrix 


Threughout this subsection, A is a k-cyclic matrix 
Mmorder nN in first canonical form. Recall that if the 
meerax OL interest is not in first canonical form, there is 
a renumbering of the states which will put it into first 
maimenical form (Theorem 3.3), and doing so will not affect 
the eigenvalues and will only rearrange the components of 
tne eigenvectors (Theorem 3.4). As a matter of notaticnal 


convenience the following definition is provided: 


Se go OS ee ce ce ee cee ee 


for any real number s as: 
a 15) e(s) = exp {-2m1 (s/k)} 


woere 


r- 


is the imaginary unit, 1/-T 


The function e is called a rotation function because 
multiplicaticn of any complex number by e(s) induces a 
Ictation cf that complex number through an angle of size 
2usyk radians about the origin in the complex plane. Note 


that for any real numbers s and t and any integer a: 


1 
See te(s)] = e(st) 
(11) e(s)e(t) = e(stt) 
(111) ¢€(mk) = e(0) = 1 


Turn now to the eigenstructure of A when A is in 


erst Canonical form. From (3.8), with M =I, note that 
D 


Since each diagonal submatrix of A is square, the product 


oy. 1s ccmfpatible as is the product A A. 5 £OD awa aro, 
ii- 
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Meeks «=29FOr i = 1, 2, .+., K, define a matrix B = 
nu 


AA oe AAA eoeeA . Although the following three 
io 1 1 k k-1 i+] 


theorems are stated and proved for B= aie. Similar results 


Moga fOr eacheE. 
aL 


Theorem 3.7 If t is an eigenvalue of A and X is a 
ih 
right eigenvector cf A corresponding to t where X = 


b 
t is an eigenvalue of B and X is 
K 


X eee en WwW 
( ad r 4 gv a 


@ecight eigenvector of B corresponding to w. 


Proof: Using Theorem 3.5 and, in particular, 
1 


mea tion (3.12): 


BX =aAA eeeA X = tA A ooeA X =auee = Ct XK = WX. 
kK x k= 1 1 =k Keka oA k k 


ir 


Deon ommermw + 0 15 an Cigenvalue of 2B and i 
is any right eigenvector of B corresponding to w, and if t 


k 
Bemany complex k-th root of w (i.e., any solution of t = 


W), then t is an eigenvalue cf A and X is a frigat 
@igenvectcr cf A corresponding to t for K = OSES STH 
where = WAG mG LOL M = 2padyc0e6.,K— 1, X = 

K mm 


miyt)A X : 
mM m-7 


wefyenneocren 3.5, all that remains 1S to show 


ito 
In 
10 
10 
lth 
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that = = Bene 5G To that end use, respectively, the 


Metiniticns of i nag ae and B and then the fact that 


s is a right eigenvector of B corresponding to w and the 
k 
fact that t = wW:; 


A X w/t) aA =e /t ean = 
k k-1 a) oe k= i k~2 k k-1 ae Di ape S 


- -— 1 -_ 


= (1/t AA 5 OE OS SS ao BX = (T/t wX = tX 
(1/t) AA ee eA X= (17k) 27 s/t) : . 


Theorem 3.9 If t is any eigenvalue cf A and X is 


_— ee =~ op ee ee oe 


T 
any Cight eigenvector of A corresponding to t, where X = 


2 a 
a Giemmnor Cach S = 1,2,.66.,K~1l, t..= tels) is 
Ss 


also an cigenvalue of A and Y is a right eigenvector cf A 
Ss 


corresponding to t where 
Ss 


at ib T T 
(et —s) %) 6 (-2s) X_,...,6 (—ks) xX )« 
Ss 71 2 k 


BeOrs First consider the case in which t = 0. Let 


S Ee any element of N - Then t = te(s) = 0 is an 
S 


eigenvalue of Aw. Furthermore, since X is an eigenvectcr and 


meres ©O for all real z, Y is nonnull. Pane ES) e4 el = aac 
S 


oe = tl 20°85 Oe Simalarily, for m = 1,2,...,k-1, 
S 


A Le(-ms)X ] = e(-ms)A X = C€ = t [e(- (m+1) s) X heey 
n+ 1 m a+1 S n+] 


Theorem 3.5, Y is a right eigenvector of A corresponding 
S 


Now suppose t # 0 and let w=t . Again, 
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let s be an arkitrary element of N - Note that 
1 


k k k 

t ={te(s)}] = t e(sk) = w. By Theorem 3.7, wis an 
Ss 

eigenvalue of B and = is a vight eigenvector of B 


Borresponding to w. Since t~ is one of the k-th rocts of w, 
S 


t is an €igenvalue of A by Theorem 3.8. Using Theoren 3.8, 
Ss 


M@@eeract that Y is a right eigenvector of A corresponding 
Ss 


Memeo lS Verified as follows. First, (Y ) = (1/t )A X = 
S s 1 Sak 


Me (17%) Ak Nate eo Proceding by induction on m (fron 


kK 
meee tO m= k- 1), (Y) = (1/ft )A X = 
Ss -@ Ss Mm a-!1 


e(-s) (1/t) A [e(-(m-1) S)X ] = e(-ms)X . The conclusicn 
m n- 1 m 


follows since e(-Ks) = 1. 


4. DETERMINATION OF DOMINANT EIGENVALUE/EIGENVECTOR 


As neted at the end of subsection 2.3, tne problem under 
consideration is the determination of a right eigenvector of 
the coefficient matrix A corresponding to the eigenvalue 1. 
The Perrcn-Frobenius theory discussed in that subsecticn not 
only led to a guarantee that one is an eigenvalue of A and 
that a ncennegative right eigenvector of A corresponding to 1 
exists; it also guaranteed that one is a dominant eigenvalue 
(i1.e., if t is an eigenvalue of A, then |t| S 1) and that 
the right eigenvector mentioned is positive and unigue up to 
Mearar multiplication. In addition, the exact form of all 
other eigenvaiues of A having modulus one and of the right 


elgenvectors corresponding to these other dominant 
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eigenvalues were determined (see Theorem 3.9). 


This section discusses some simple iterative methods of 
determining the sought-after right eigenvector. Since many 
of the central-server models of interest are cyclic, the 
effect of applying these methods to a k-cyclic matrix are 
considered. For a more extensive account of the acyclic 
case, the reader is referred to Householder [53]. The 
methods discussed here closely parallel the stationary 
iterative methcds for solution of a system of 
(nonhomogeneous) linear equation discussed by Young [114] in 


Mee third chapter. 


Once again, even though the discussion is confined to 
right eigenvectors, a parallel development is possible for 


left eigenvectors. 


Tre well~kncwn power method.1s a favorite tecl for 
determining the steady-state probability for finite ergodic 
Markov chains in beginning stochastic modelling courses. It 
Will presently be shown that this method runs into 
difficulty whenever the matrix under consideration is 
cyclic. Nonetheless, it is an important method since eéach 
of the cther methods to pe discussed is equivalent to the 
power method applied to a matrix which is derived from the 


meertx Of interest. 


bet A be a matrix of order n. For the present, 
assume ne further knowledge concerning A or its 
eigenstructure. The power method is an iterative technique 


0 
Which gererates, for some starting vector X , a seguence 
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1) (2) (3) 


@e vectors Xx ak pk (eee OWRSEeC FOr e€acn 2. 2. 42 


4 eee 
(3. 16) tos b- ‘vag 
Le 


where b is a normalizing factor. Under appropriate 
at 


conditions, the normalizing factors b will converge toa 
M 


; : (i) 
dcminant eigenvalue orf A and the vectors X will converge 


to a right eigenvector cf A corresponding to this dominant 


eigenvalue. Note that (3.16) can be written as a sequence 


mee guations as follows: For j = 1,2,...,n, 
(i) , (i-1) 
i = 1S 

(3.17) xX —wor 2a x 
5 at “ae TS hs 


Keeping this formulation in mind, computational 


implementation of the power methcd follows: 


The Power Method 
- (0) . 
me) Choose a starting vector X ripcle si shiah fell Solivd 1 ja Co 
(row) vector Z, and a convergence criterion. Set 
m= 1. 


(1) (1-1) 
X ; 


mer) Caiculate Y = A Computationally, 


this is accomplished in the following manner: For 


fe 1,2,6--,0, 
i oa 
(3.18) a = >a a. 
j jk x 
k=1 


iz 








p. . (1) (1) -1 (i 
Mert) Let b = aY and” x = Dd. y | is 
ai i 
mem of i — 1, or if i > 1 and the convergence 
SmecELicn 2s not satisfied, increase i by 1 and go 


to (11). Otherwise, the method has converged; bo 
a 


, ee = 
1s a dcminant eigenvalue and X is’ a) bigne 


eigenvector corresponding to b . STOP. 
= 


Typical normalizations used set the sum of the 
(i) 
components of X egual to one (all components of Z are 
. (1) 
ones) or set the first component of X equal to one (the 


first component of Z is one, all others are zero; b = 
ae 


y ). Typical convergence criteria include: the absolute 


difference between b and bd. is small, the percentage 


1 i 
difference between b and b as small, the largest 
al he 
a ; , 1) 
absolute difference between corresponding components of X 
(1-1) | 
and xX 1s small, and the percentage change in «he sum of 


the absolute differences between corresponding components of 


(1) ee). 
X and X is small. ("Small" means "less than e" for 


Scme e > Q.) 
Turn now to the coavergence properties of the fower 


Metnod. Stprose that there are m distinct eigenvalues of A, 


Nnanely a Mee, ae , numbered such that 
Z m 
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B.19 eoieeiiced 2... > |t 
( ) ; ; ae 


Note that all cf tte right eigenvectors of A and all of the 


vectors generated in the power method are elements of the 
: n 
space of n-dimensional complex vectors, hereafter called c. 


n 
It can be shown that there is a basis of C , er = ae Loe 


1s associated with exactly one 


meeyen }, Such that each H 
n 1 


Gigenvalue cf A, and if B is the subset of a associated 
J 


with elgenvalue t ror some j = 1,2,...,m, then each right 
a 


eigenvectcr cf A corresponding to t is a linear combination 
J 
@recne elements of B . (For those familiar with this 


J 
surject aréa, the elements of a are the columns of a matrix 


-1 
H such that KB AH is in Jordan canonical form. Others arse 
referred to Househclder [53].) Consider a special casé in 


which each element of - 1S an eigenvector of A. More 


general situations exist. However, tneir consideration 


léads to the same conclusions, complicates the analysis, and 
adds very little in the way of insight into the subject 


Meee r Of this thesis. 


n 
Since oe is a -~asis for C and any starting vector 
(0) n (0) 


K oso inc , X Can be uniquely expressed as a linear 


COmbination of the elements of oe Since each element of a 
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Ms an eCigenvector of A, property (iii) of eigenvectors 


implies: 


m 
(0) 
(3.20) X =e. | Vo 


Meo 1S a right eigenvector cf A corresponding tot. 
j j 


Note that V is a linear combination of the elements of 3B 
3 j 


for each j = 1,2,.-.,M. Suppose now that a normalizing 
Meeror Z has keen chosen. For each S = 1,2,3,¢.6, 
S 


ly 
J) Aa 


iA 8B 


—1 
fe. 21) x = (JT oy 
124 j=4 


where D is aS in step (i111) of the power method. 
al 


Consider the case in which nee > eis Then, the 


goal in agrplying the power method is tec find the value of cs 


“~. 


and a right eigenvalue cf A corresponding to tae ite eK is 
meenorthogonal to all of the vectors in ee then ey # Q and 
the power method is guaranteed to converge to 2 and scne 
multiple cf the right eigenvector Ns To see how this 


happens in the case under consideration, rewrite (3.21) as 
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Ss 


=| 


(S) 


i. 22) x eri (e.7b.}1> (t/t) ¢ Vv 

ee eat 8 2. 2 ec nS at 

1=1 j=1 
S 

2 lee v Se) eo 

= + 

{ i" ql le ( ne AY ie 

1L= 


Ss 
Cemeeeeet: “Go tw) CoN} 
m 1 m 


Ss 
Since Re | Pe OL fo > 2,p3,+.6,D,y CT, goes to zero 
J 2 
as S increases. Hence, the sum approaches ores To see 


what happens to the factor preceding the sum on the right 
hand side cf (3.22), consider a value of s so large that the 
Sum can fe repiaced oy ee PRen ate placrng Cho Eacter 


; (Ss), 
preceding the sum by w, (3.22) shews that X 1s 
S 


approximately egual to w Spa Following the steps of the 


=> 
(s¢1) | 
power metkod, Y 1S approximately egual to w aw = 
Ss 
meet V and b Pa eaOpEOKIMatecly equal to wect 2V = t 
1 s+1 s 11 1 1 


= 


(S) 
Since X had already been normalized. Thus, w a = 
S 


mt /D lecmeweecnpcOoximarely. So, b converges to t. and 
ot )6|6S+1 S S 1 


(s 


X converges to a multiple of a: Also note from (3.19) 


ea {3.22) that aoe |} is a measure of the rate at which 
1 
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mas COnvergence takes place. That is, the smaller this 


@antaity 1s, the mere rapidly convergence takes place. 


(0) 
mi xX teeOncnogonal to all of the vectors in 3 


ee oF [oj tiene tt 25 Seon from (3.21) that the pewer 


method cannct converge to oo and a corresponding right 


eigenvector, though it might converge to one of the other 


eigenvalue/yeigenvector pairs. 


Ncw consider the case in which od = eal Dt | 


for some 1< k £ m (where t =I0-2eekP=on). thas 2s the 
nt 


Meee it A is k-cyclic. Then, for large s, terms involving 


t » ie jee, Ce tn (3.22) can be ignored. The 
k+1 k+z 4 


(approximate) result is (3.22) with the upper limit on the 


(Ss), 
eam changed from m to k. So, for each s, X 1S a linear 


cCmbination cf the right eigenvectors Ue Ue ~--, V where 
K 


the coefficients are dependent upon s. In the case that A 
is k-cyclic, Theorem 3.9 gives some insight into the nature 


of this dependence. [In particular, Cae = G4) OL, y= 
J 


Mey. ..,k. Sc, we get (approximately): 
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k 
(Ss) 
fe. 23) X Sven ( 59) CV. 
sS J 


j= , 


—.. . S) 
From this it is easy to see that (for s large) x is 


(s+k) 
approximately the same as X but probably different froa 


(s+1) (St+Z) (s+K-1) 
a Xx Paice. Wg - Even w does not converge, 
S 


S 
though Jw | does. Note that even though the sequence <i " 


ee 


(stk) (S+Zk) 
X x 


; jews converges, the limit is not an 


eigenvector cf A, in general. 


Example <:.1 


Consider applying the power methcd to the following 


Mmemm=gative, 2-cyclic, irreducible matrix A: 


0 1/24 
gy ] 

| be (1) 
Mees ctOlicwing table lists the first four b,'s and &X Sis 

a 

The normalizing vector is Z = (1,1); the starting vectcr is 
given in the table. 

a 0 1 2 3 4 

9 Tie 27a HZ 2/7 


(i) ¢ 24 e-1f7q ¢ 2g etsy fF 
L-73 & 8/74 t-14d & 8/74 t-15 
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By Theorems 3.6 and 3.9, A has two distinct eigenvalues; 


beth are reali and one is the negative of the other. The 
Beertive eigenvalue is between 1/2 and 2. Noticing that 


-4 pad) 15 rl 0+ ; 
RAE = | | where R = [| Ple@mGcanmoe COnDCLuadeda £EGE 
1 0 Q 24 


Theorem 3.4, part (viii) of Theorem 3.6 and Theorem 3.9 that 


the eigenvalues of A are 1 and -1. It is important to 
notice that the reason the power method does not converge is 


meat A is cyclic. 

Another problem with tne power method involves the 
Choice cf Z. For example, if the sum of the components of 
" Memeeerc, then Z = (1,1,...,1) will lead to difficulties. 
Since ‘i is unknown prior to application of the power 
method, there is cften no assurance that any particular 


Beotce Of 3 will avoid this complication. However, if A is 
nennegative and irreducibla, Theorem 3.6 parts (ii) and 


(421i) guarantee that V has no zero components and that all 
1 
components of V have the same sign. Thus, both normalizing 
1 
procedures mentioned earlier in this subsection are 


guaranteed tc avoid such difficulties. 


These same parts of Theorem 3.6 can also be used to 
help avoid the proklen of choosing a starting vector which 


2S Orthogcnal to V . Since all of the components of ee have 
1 
the same sign, any vector orthogonal to oe must have scne 


components with positive real part and some with negative 


Q 
Meal part. Soif x has all nonnegative (cr all 





R. . (0) 
honpositive) components, X cannot be orthogonal to Vv. 
1 


As a final comment concerning the pcwer method note 
that the purpose of the normalization procedure is tec insure 
that the methed converges to a nontrivial value. Without 


the normalization procedure (3.22) becomes: 


I 
Ss S 
(3.24) X =e (te /ta) cc. ¥ 
1 Diese Jaa 


J. 


The Sum cn the right hand side of (3.24) is the same as the 


Semeon the right hand side of (3.22) and approaches the same 


Ss 
limit as ¢ becomes large. However, approaches zero if 


| Mere or infinity if Fh, > et ees Ee aL = 1 but -s * 1, 
then cE , = exp{yi} for some real number y which is net an 
(st+1) 


integer multiple of 2n. In this case for large s, X = 


CS 


(Ss 
exp {yi} xX approximately. That is, the magnitude of the 


vectors generated by the power method will converge, but 


there will be an angular displacement of y radians between 


successive vectors for large s. As indicated at the end of 


Subsection 3.1, t = 1 for the cases of interest in this 
1 


thesis. In such cases normalization is not required fcr 


convergence cf the power method. On the other hand, if the 
convergence criterion used in step (iv) of the power method 
is based upon an absolute difference rather than a percent 


difference, the normalization procedure (or lack therecf) 
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will affect the number of iterations necessary to attain 
convergence and the degree to which the convergence 


criterion is satisfied by the final answer. 


Fer example, Suppose that the convergence criterion 


(s) (s-1) ~4 
se | < 10 . Suppose that after k steps 


me 32xMmax [Xx. 
fH 1 a: 


> . | (kK) = (k-1) 
Meas found that rax {|x  ~-X. | 
se: me 


-4 
= 0.8 x 10 . Then, the 


(kK) (k) 
method has ccnverged and P = X VA ATES ) is the desired 


scluticn to the system (3.1), (3.3), (3.4), where Z = 


, (k-1) (k-1) 
Memes. , 1). Eut, if Q = X VR Va eke 2 SNe 
; -4 (x) 
(approximately) and max |p ~-q.{ = (0.8x10 )/(2ZX ).- Note 
5 Wipes Cuma | 
. (k) my 
moat if 2X “Qeuec, Max |p —q |~> 10 $; 1.€., more 
5g ie Oe 


iterations should have been performed. By way of contrast, 


(k) 


=5 
me «2 X mec, ax ip —¢ [| < 10 and fewer iteraticns were 
ae 
Meemably required. Now if c is chosen so that ZV = 1, 
J J 
( 0) 


(k) vf rT . , 
then ZX = oe = ey Maine) which is highly dependent 
upon the relationsnip between the starting vector and the 
desired scluticn vector P = ie (see equations (3.24) and 


me20)). Since ie is unknown, this relationship is also 


unknown. 
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4.2. The Relaxed Power Nethod 


The power method is homologous to the Jacobi method 
for iterative solution of a system of linear equations. The 
method discussed in this subsection is homologous to the 
relaxed Jacoki method. Young {114], Chapter 3, is suggested 
as kackgrcuné reading for the subject of this and the 


following twce subsections. 


The relaxed power method yields at each iteration a 
weighted sum, or average, of the vector calculated in the 
power method and the preceding vector from which it was 
calculated. To specify this method replace step (11) cf the 
power method Ly: 

(i1) Caiculate oe = wien + Gomes 
Computationally, this is accomplished in the 


Seerowing Manner: For j = 1,2,..e,0, 


25) ile! = W 


: k 


(nea)) 
x 


(a="1) 
x 
jk k : 


a + (1-w) 


1 


il IM 3B 


Megalbly the real number w is chosen at the Start (1.¢€., step 
fey, though it could conceivably be changed at each 


meeration. 


The ccnceptual difference between the power methcd 
and the relaxed power method is best illustrated in terms of 
Mieanalogous situation. Consider attempting to determine a 
Met ion for an equation f(x) = 0. Using some iterative 


Method (e.g., Newton's method), a sequence of numbers 


SARS is generated which converges to a number x 
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mmemethat £(x) = 0. This is done by choosing a starting 
value EO acme sor 1 —si,2,3%.-.-., letting x = g (x ) where 
at a 


g is a functicn scmehow related to f. Now consider an 


attempt tc accelerate the convergence by developing a 


sequence oes} where =e aad LOG = an = 
a AYQeYe¥ os } Yo 0 B. a ae 
wg(y. a + (1-wW)y. A How could w be chosen so that the 
a o 
umeomecoOnverge to x more rapidly than the x 's? If the 
i x 


function g is known to consistently overshoot the mark 


(i.€., if x is known to always lie between a(y) and y), then 


choosing w between zero and one will always put y between 
J 


acy . ) and y and (hopefully) therefore closer to x. On 
is a 
the other hand, if g 1S Known to consistently undershoct the 


Mees, then a choice of w > 1 will push y_ beyond g(y- ) and 
3 an 


Meeain, hcrefully) closer to x. 


Similarly, the relaxed Jacobi and relaxed pcwer 
| (i) 
methods seek tc choose w so that the resulting X at each 


Meeration is closer to the vector sought than it would be if 
W= 1 (1.€., no relaxation). The method is said to be an 
Uunderrelaxed method if 0 < w < 7 and an overrelaxed method 
1iw> 1. The question of whether to underrelax or 
MemoelaxX in a particular situation seems to he related to 
the values of the eigenvalues of the matrix in question. 
Since these are generally not known, the question of what 
Value to give w is usually a difficult one. Wallace and 
Rosenberg [108] use a relaxed power method in their 
recursive queue analyser program. They suggest w= 1.3 as a 
gocd choice in many of the problems they have solved. The 


chcice ot w for k-cyclic matrices is investigated in the 
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memainger of this subsection. 


Notice frcem the revised step (ii) akove that the 
relaxed power method is the power method applied to the 
Meerix BD = wA + (i-w) I. If Ais a nonnegative, k-cyclic 

W 


Merreducikble) matrix, then B is irreducible (all nonzero 
W 


positions in A are stiil nonzero in Bel is acyciac itt wos 
1, and i¢ ncennegative if 0 <w< 1. So ute can be viewed in 
terms of Ferrcen-Fropenius theory if 0 < w< 1. However, 

mcre infcrmation can be obtained by directly examining the 


relationship kEetween the eigenstructures of A and bB. 
W 


Let t be any eigenvalue of A and let V_ be any 
J 


J 
Tight eigenvector cf A corresponding to t . Then, BV = 
3 3, 
[wA + (1-w)IJV = WAV + (1-w)IV = wt Vio+ (1-w)V = 
J J J Sie J 
Suet t-wW) Vv . That is, V. is a right e¢igenvector of B 
J J J W 


Corresponding to eigenvalue [wt + (1t-w) ]. In essence, the 
3 
relaxaticr leaves the eigenvectors untouched and replaces 


each eigenvalue t by a weighted sum of t and one, g(t) = 

wt + (1-w). Note that t = 1 is the only fixed point fcr the 
MeanstOrmaticn g. If 0 < w< 1, g(t) is closer to one than 
mss if w > 1, g(t) is further away. (If w< 0, g(t) is 
On the other side of one.) This transformation of t by g is 
performed alcng a straight line in the compiex plane passing 


through t anc cne. 


Ncw consider the case in which the coefficient 
Matrix A is k-cyclic. Let t be any eigenvalue of A such 
mee it] = 1 but t # 1. (Note that Theorem 3.6 guarantees 


the existence cf k - 1 such eigenvalues.) Since the 


184 





straight line in the complex plane pasSing through t and one 
intersects the unit circle only at t and 1, g(t) will te 
outside the unit circle if w> 1 (or w < 0). That is, if w 
> 1, one 1s no longer a dominant eigenvaiue and the power 
method will nct converge to the desired eigenvector. Cn the 
other hand, if 0 < w <1, all of the eigenvalues on the unit 
circle (except one) are drawn into the unit circle as they 
are drawn clcser tc one, and one is the unlgue dominant 


eigenvectcr cf B. 
W 


Now consider more specifically the effects of this 
transformaticn on the elgenvalues of A. Supfose wis any 
real numker between zero and one (noninclusive) and let t = 
(x,y) be any eigenvalue or A other than (1,0). (The ordered 
pair notation for complex numbers is used here.) The 


megeuvatuc cf B ccrresponding to t is g(t) = wt + (1-¥) = 
W 


(wX+1-w,wy). The question 1s whether g(t) is closer to the 


meen OF further from the origin than t. Sc, note that: 


Ig(t) i < itl 


Zz DB Z a 
mer (wxti-w) +wwy <x +y 


Zoe 2 es 2 
mer (i-w )y + (1-w )x - 2w{i-w)x - (I-w) > 0 


2 2 
tff y + xX -— 2lw/(itw) jx > (1-wW)/ (1+) 


Zz 


Mee y +[x - i) 1 > ee 

From this it can pe seen that the transformation will draw 
closer to zero only those eigenvalues outside the circle in 
the complex flane with center at (w/(1+w),0) and radius 

17 (1+w). Those eigenvalues inside this circle will be drawn 
Mezther from the origin. As depicted in Figure 3.1, this 
Murcie isc inscribed within the unit circle, touching it cnly 
mum). Since 0 < w <1, 1/2 < 1/(itw) < 1. Hence, the 
origin is always within the circle and the circle GOnrains 


at least cne-fcurth the area of the unit circle. This type 
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LY 


Figure 3.1--Effects of the Relaxed Power 
Method on the Eigenvalues of 


Magnitude Less Than One 
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memintocrmaticn is sufficient to determine the best the case. 
value for w {in terms of the ccnvergence properties of the 


power method on B ) if all of the eigenvalues of A are 
Ww 
knewn. Unfortunately, this is seldom Precise theorems cn 


the convergence prcperties of the relaxed power methcd are 


very difficult to determine. 


One €xception is the case in which A is a k-cyclic 
matrix and one 1S a dominant eigenvalue of A. Since k of 
the ¢igenvaltes of A are known (they are the k-th roots of 


unity), the eigenvalues of saat corresponding to these can be 
used to provide a lower bound for the measure of convergence 
of the pcwer method, eons Itieee ice 32 27.9 30O1ne “cd is at 
the eigenvalue of A on the unit circle closest to point a, c 
aS at the eicsenvalue cf ad corresponding to the eigenvalue 
of A at d, and b is at the midpoint of the line segment ad. 


In radians tre angle aod 1s 2n/k, angles aob and bod are 
each haif of this or nyk, angle cod is w(2nyk), and angle 
aoc is (1-w) (zn/k). Line segments ao and od each have 
length one, and line segments ad and ob are perpendicular. 
Frem this it can be concluded that line segment ob has 
length cos(nvk) and line segment oc has length: 
Me-mbcoci(n7k) isecija/k — {2n/7k) win (¥, t-w) |] 


Since point c is at an eigenvalue of B, ay a oa eee 
W Z 


h. Choosing w to minimize h may reiax this lower bound 


Without imprcving the convergence properties. Note that 


mrs Dound is useless.if k = 2. 
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Mmeeure 3.2--Effects of the Relaxed Power Method 


on an Eigenvalue of Magnitude One 
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fro ine Gauss-Seidel Method 


Returning to the steps of the power method as set 
Merten in subsection &.1, note that at each iteration all of 
the compcnents of the old vector are used to determine each 
component of the new vector. Computationally this means 
that the cld vector must be retained in storage at least 
until the new vector has been completely determined. 
However, note that at each iteration, step (ii) is 
acccmplished Ly, in sequence, applying (3.18) with j = 1, 
Maeno With j = 2, then with j = 3, and so forth. In other 

(i) 


Mmerds, £Cr j > 1, i Pom wmonwnytOn kK =p 22 c06e5 go> land 


eS a 
could be used in the place of x" in calculating i. - 
J 


Mees 1S, in effect, done if (3.18) is replaced by 


j= 1 n ; 
(1) (1) (=) 
(3.26) wue= > aly|6|6* US ax 
5 jk XK jk &k 
k=1 k=3 


Mmrs obSe€rvaticn is the basis of the Gauss-Seidel method. 


Consider the matrix manipulations necessary to 
Téplace (3.18) by (3.26). The matrix A can ke uniquely 
Written as A = U0 + L where U has all zeros below the main 
diagonal and L has all zeros on and above the main diagonal. 
Mme collecticn of eguations specified by (3.26) for j = 1, 


Meese. -, 0 is represented in matrix notation as 


| = 
i. 27) eas = ae + ux : 
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mance L has all zeros on and above the main diagonal, I - L 


| | 1 
is nonsingular. Collecting the terms involving y' and 


—_ 


, 
Mercaplying through by (I - L) (3.27) becomes 


a oa 
(3.28) i (I-L) ux 2" 


Lefinition 3. 


—_—— =Ep 


8 Let A be a square matrix. Then the 


coy 


mmerax G = (i-L) U is the Gauss-Seidel iterativ 


A where L and U are the unigue matrices such that L has all 
zeros on and above the main diagcnal, U has all zeros rcelow 


the main diagonal, and A= L + J. 


The Gauss-Seidel method is the power method aprlied 
to the Gauss-Seidel iterative matrix of A. To specify this 
method replace step (11) of the power method by: 


; ee 
(1) ea ) 


(11) Calculate Y = where G is the 


Gauss~Séidel iterative matrix of A. 
Comrutationaily, this 1s accomplished by 
successively applying (3.18) with j = 1 and (3.26) 
meetin |) = 2, 3y «sey Nz 


Very little is Known about the relationship between 
the eigenstructures of A and its Gauss-Seidel iterative 
Matrix, G. It can be shown that G is nonnegative if A is 


mcnnegative. Seneta [99] shows that if A is nonnegative, 


the Perrcn-Frobenius eigenvalues - (of A) and - (of G) 


have one cf the following relationships: 
MeO < © < c < 1: OF 
G A 


(Lt ) a =—ie—et * OL 
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Mee) t<c <r. 
A G 


Maeenme Cases Of interest in this thesis, of course, (ii) 
applies. In fact, there is some hope that the Gauss-Seidel 
method will ccnverge to the desired eigenvector, as can be 
seen in the fcllowing theoren. 


Theorem 3.1€C Let A = U + L be any square matrix and 


a 
let G = I-21) u be the Gauss-Seidel iterative matrix cf A. 
Then one is an eigenvalue of A and X is a right eigenvector 
Of A correspcnding to one iff one is an eigenvalue of G and 


X is a right eigenvector of G corresponding to one. 


BEOOLS XX = AX = (UFL) X 
at £ Or-L) Kk = UX 


Pet xX = (I-L) UX = Gx. 


Add to theorem 3.10 the result, extracted from 
Seneta, that cne is the Perron-Frobenius eigenvalue of G in 
the cases of interest in this thesis, and indeed there is 
scmé hope that the Gauss-Seidel method will converges tc the 
desired eigenvector of A. One primary problem still 
Temains: G may be cyclic. That is, the Gauss-Seidel method 
May not ccnverge. The following theorem, which is perhaps 
the mest striking result known about the relationship 
between tke eigenstructures of A and G, considers this 


meooplem in the case that A is k-cyclic. 


Meeotemege il Let A be a k-cyclic irreducible satrix 
Of order n in first canonical form (as specified in (3.3) 
With M = I). Let G be the Gauss-Seidel iterative matrix of 


Meinen, if t , t ,..-, t are the distinct eigenvalues of 
m 


A numbered sc that (3.19) is satisfied, and if 
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a eit | 
| 7 mee 


PeeEXCEEt aS Specified in (ii), t is -an 


eigenvalue cf G iff t is an eigenvalue of A. 
(ii) Zéro is an E€igenvalue of G (even if it is 


not an é€igenvalue of A), and every nonnull vector 


It JU Sk Ab 
Meeesuch that X = cS CS aaa where cS = 0, is 


an eigenvector of G corresponding to zero. 


(iii) The Gauss-Seidel method will converge 


(barring an unfortunate choice of starting vector) 


k 
to an eigenvalue w= ee and an eigenvector X, such 


T Seer wh | 
that xX = Cee eX) « where Ae 1s an 
eigenvector of B = ae ae corresponding to w 

K= 


Sees theorem 3.7) and for 1 = 1,2Z,.-.,k-1, xX = 
1 


1/w)A A oa: ae, ae 
a? 1 i-1 AK 


Paeoteo nn riret determine the form of G in terms of 


ED Sa ae a 


the submatrices of A. 


t32Z 





° — 
= e 23 | 
<q AS ° a Qa 
' 
ae 
. A 
a a At a 
N 
4 . 
se a Q isk 
_ 
= ® 
a a : A A 
a ne | 
WT 
—_ 


GC 
AST Qa Q 4 
° %< 
a a Q ao} 
° f 
(ae) e 
=e 
Ak BQ HH Ask 
N 
= ~ e 
us MH ec Dy 
) 
Ae ® 
cc N 
4 - a & 
bee CPO a ry AR eo, Se OR OT a eee cal 
N 
4 
' 
4 


aa 
Sy 
As w ist Hy 
ois 
Ast Qa Q rx 
Fant i 
«x 
on) ° 
Cc — 
aw Q ae | ® | 
ne 
foo 0 
A 
r= | 
8 
FX] 
N 
a ~m 8 = 
Ack a «L ‘ 
oe 
ri 01 
ace 
«7 
N 
ocx} 
e 
= N ® 
ja} N a ad 
KH co 6 (9.8 t 
<q aa 
a 
° ag 
ey 


(I - L) 


Ts 





| aw 1 ] 
i 1 
_ a a 
: ! 2 | 
G = (I-1L) U = a) gD oce GC Ren 
a 2 ul 
iis #ee#e8¢#@%e#8#8¢#°®@ s@e@e8t@e#8f @ @—hUhOOrhUCcCOCUCOhCUCUhHCUChM]!UCUC!COCUC!O! e® ees @ 
| 
eee a | 
- k k-1 1 
T L T 
Bet £4 = X = ({X ,X a) be any vector of length 
m Then, 
A X 
ae | 
| A A X | 
| Z, a ke 
(3.29) al AAA X 
6 2st 
| 
{ eeeese#e¢?e oy Ge co 
: | 
en ae l 
Lk k-1 Tk 
which is independent of oe ae cesses : Note fron 
k= 1 


(3.29) that wis an eigenvalue of G and X # € is a right 


Segenvectcr cf G ccrresponding to w iff 
wX = AA 5 chiens 


Di shel | 1k 
Mee = 1,2,...k. In particular, wX =A A ie ee ae we 
K k k-1 1k kK 
Part (1) now fcllows from Theorems 3.7 and 3.8. Part (ii) 
follows immediately since X = 0 implies GX = 0 = OX. By 
i 
K kK k 
Meorem 3.8, t = +t =... = t. Since |t j{ > ft l, t 
1 Z k k k+1 1 


is the unigue dominant eigenvalue of B. This is sufficient 


me prove (iii). 
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The proof cf Theorem 3.11 relies heavily upon the 
hypothesis that A is in first canonical form. It is natural 
Memon tf the results (particularly part (i)) are 
independent cf this assumption. For k > 2 the answer is 
negative. iIn fact, a proof similar to that of Theorem 3.11 
Feveals that G is cyclic of order k-1 (though not a 
irreducible) if A is in second canonical form. The 


following example illustrates that point. 


Example <:.2 


O25: 1-0 
Let A = (9 : if. itch, A 2S I= velle dnd £eredauci ble. 
r0 1 Oy rc 10 Oy = rl 0 Cy 

Also U = {0 C 1 Leal = OertnO a = ola 
: Lo 6 od’! ty ae LS go 

rc 1 ors ; : 
and so G = {0 0 1{. Gis seen to have period 2. 

tc 1 04 

In the case that k = 2, the first and second 


Cancnical fcrms coincide. Hence, an example similar toa 
example 3.2 wiil nct yield a negative result. For this 


Case: 


Beaueccire; If Ais a 2-cyclic, lrreducible matrix, 


o_o Pee oe 


and 1f G is the Gauss-Seidel iterative matrix of A, then t 
| Bae a | 
Meean ©lgenvailue of A iff t is an @igenvalue of G, except 


that zerc is an eigenvalue of G even if it is not an 


@igenvalue cf A. 


Prom £irst Canonical form, this result is true 
Dy Theorem 3.141. The foliowing theorem lends plausibility 
Memcne ccnjecture ky showing that it is true if A is in 


mmerd Cancnical forn. 








Theorem 3.12 Let A be a 2-cyclic matrix in third 


=_p agp ae eee ee ee oe = —_ =_ 


Canonical form as specified by (3.9), and let G be the 
Gauss-Seidel iterative matrix of A. Then 


(i) zerc is an eigenvalue of G and any nontrivial 


vectcr Y such that Y = aX epost Sa 


eigenvector cf G corresponding to zero; and 
(ii) t # 041s an eigenvalue of A and X is an 


eigenvector of A corresponding to t, where X = 
3 e 2 * ¢ 
a oe soon eG iff t # 0418S an eigenvalue of 


G and Y is an eigénvector of G corresponding to 


2 T Siete: 7 k-1 7 
t , where Y = Ver dae ie aa Aoi 
Proof; First determine G in terms of the 


Sukmatrices c£ A. 


cB | ne 2 22+ @ 4 1 
| a 42 | 
le ! 
" ao * 5 3 cee @ @ : 
- | 2 | 
12 x D eres ee i) | 
n | 
U = | 3 | 
| e«.6UtlC< A | 
" 4 - i rom ate 
k-1 | 

| 
|Z Dp @ o2- @ g | 
| n | 
L k J 
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i n \| 72 
1 
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ag Zi 12 

A A_A 
ls S75) Ea 

G= | 

6 6 See ®@eee¢?ée. 
| K-11 

A A 
ig i, Flea 12 
| k 

A A 
? (Ul, ated 12 


A 


23 


AA 
3 2on2 3 


k= 1 
(TTA 


ya 


1=3 1,1-1 23 


k 
(TT A 


ayes 
=o e2 bed). .23 


Frcem this representaticn of G, (1) 


Now suppose that w # 0 is an eigenvalue of G 


POMUOWs sl eecr iy. 


and Y 1S an eigenvector of G corresponding tc w, where Y 


i tT 
oe 47 oy, )- Then, wY = GY implies: 


(3.30) wY =A 


4 


ic 
eZee 


Met ] = 2,35-4-ykK-1, 
ge ee 
f).31) oyeo— A XY ee ae 
y De dhe Ul ajane 1,1- 
S=2 1=s 
One conseguence of (3.31) is that, for j 


198 


A if 
A 


s-1,S s 


gts = 2p Ke 


ag ee 








=. 32) wA ) ae 
1/70 biog ee 


j-1 5-1 


eet > (77 A a Y +A Yj 
2) Peale ; oe ea s-1,S 5s i lone 5 
S=2 1=s 


3) ee, 


2 (ee: 
mt 


s=2 1=s 
SeemeecOr ) = 3,4,...,k-1, (3.31) and (3.32) result in: 


fe. 33) wY =A Y¥- 2 EN 
5 Jegtl jt gsc: ya 


which is alsc seen to hold for j = 2 as a special case of 


memory. Finally, wY = GY and (3.32) imply: 


(3.34) Y =A Y 
k k,k-1 k-1 


Meemecelaticns (3.30), (3.33) and (3.34) are a set of 
necessary and sufficient conditions for w # Q to be an 
eigenvalue cf G and Y an 2igenvector of G corresponding to 


W. 
The following similar set of necessary and 


Sufficient ccnditions for t # 0 to be an eigenvalue cf A and 


a 
X an eigenvector cf A corresponding to t, where X = 


a 
ER can be obtained directly from tne form of A 


Memspecified in {3.9): 


i. 35) tX = A X 
1 252 
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A x + A 


Ae ; a ye EO Geirse cies «cay Sa 
5 Haat i jt Dae) oa 


(3. 36) tx 


It 


(3.37) tX A x 
k k,k-1 k-1 


Mestmpie verification that the conditions (3.30), (3.33) and 
Mest) are equivalent to the conditions (3.35), (3.36) and 
1-1 


Z 
Mmemesy) 1f w=t and Y =t MeECEOLr 3 = 1, 2a. 7 Ku mew 
1 a 


completes the proof. 


emellary Let A be a 2-cyclic, irreducible matrix in 


merrd cancnical form. [f Oe Cae Ciena r Cathe distance 
m 


eigenvalues cf A numbered so as to satisfy (3.19), and if 


meme it i, then the Gauss-Seidel method will converge to 
Zz = 


2 at 
an eigenvalue w = and an eigenvector X, X = 
a oe , a pee Boe ie 
coe Wc ip Se ic t ese LS sao 
1° oad g yf ( 4° i oe i ae g i k 


Cigenvectcr cf A corresponding to t for i = 71,2. 
i 


rr 


| 


Baiersmmotnce jt { > {t_{ and w= t. = t., w is the 
2 3 1 2 


Unigue dominant eigenvaiue of the Gauss-Seidel iterative 


Matrix of A ty Theorem 3.12. 


The importance of Theorem 3.12 and the corollary 
Merlowing it is brought into focus by the -realizaticn that 
arrangement cf the states according to a lexicographic 
Meaering cf the ISTATEm1 or the ISTATEm2 vector 


Bepresentaticn results in a coefficient matrix A in third 
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canonical form for many of the 2-cyclic models discussed in 
the preceding chapter. For example, consider any central- 
server model in which all service distributions are 
exponential and no blocking or bulking can occur. At each 
transiticn the number of jobs at the CPU either increases by 
one or decreases by one. The result (see Appendix A) is 
that each such model is 2-cyclic. An ordering of the states 
Mach yields a coefficient matrix in first canonical fern 
Will necessarily list all of the states having an odd number 
ef jobs at the CPU followed (or preceded) by all of the 
states having an even number of jobs at the CPU. the 
ISTATEmM? and ISTATEm2 orderings list all states with N jobs 
at the CPU, fcllowed by those with N - 1 jobs at the CPU, 
followed by those with N - 2 jobs at the CPU, and so forth. 
Since the nugber of jobs at the CPU changes by exactly one 
Wath each transiticn, the resulting coefficient matrix 1S in 


mera Cancnical forn. 


The corcllary to Tnoeorem 3.12 says that the 
Gauss-Seidel method will converge for these models. Ncte 
that since the Perron-Frobenius eigenvalue of A is one in 
these cases, the Perron-Frobenius eigenvector of G coincides 
With that of A. Thus, the Gauss-Seidel method will converge 
to the sought-after eigenvector. Because of this and the 
éase with which this method is programmed, the Gauss-Seidel 
method is the one used in the models programmed by the 


author (see Chapter IV). 


Nete that Theorem 3.11 guarantees convergence cf the 


Gauss-Seidel method if A is k-cyclic and in first canonical 


form. The measure of convergence is yea ee ewes {abe 
K 
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in contrast to the to the relaxed power method where this 
measure must pe expressed in terms of all of the eigenvalues 
of A. In the relaxed power method the dominant eigenvalues 
of A are transformed to distinct eigenvalues of the 


iterative matrix B. Umaemstne. Comai1tions described in 
W 


Theorem 3.11, they are all transformed to the same 


(dcminant) e€igenvalue cf the Gauss-Seidel iterative matrix G 
and, thus, will not affect the rate of convergence, as they 


could in the relaxed power method. 


It would be natural to next ask if it is possikle to 
improve the ccnvergence properties of the Gauss-Seidel 
method by inccrporating a relaxation procedure. Indeed, 
Since the first two eigenvalues of G are distinct, a choice 
of w> 1 may be appropriate. Incorporation of a relaxation 


precedure may take place in at least two ways. 


First, a wéighted sum of the old vector and the new 
vector may be taken at each iteration. To specify this 
method, replace step (ii) of the power method as specified 
in the preceding subsection and replace step (111) by: 

. (i) (1) (3) 


fri) Let b = Z and X = (w/b )¥ + 
1 1 
(2i— 1) 
(i—w) X . 
(i), (s1)) 
Note that X will pe normalized since both X and 
or (1) 
Be Y are. 
1 


Second, a weighted sum may be taken as the new 
vector is generated. To specify this method, replace step 


mer) by: 


7 (1) 
eo) Caliculate ¥ by letting 


ZZ 





Hl 
i i-1 i-1 
ees. et). ews 
1 ie kK 1 
k=1 


meee tOL J = 2,3,-4-,n, letting 


) oe n 

1 al i-1 

yo: susaiy + Sa x| 

5 jx k 7 oS bs 
k=1 k=j 


= Yl 
Z (1-w) x6 | 
J 


Neither cf these two methods has been investigated, either 


analytically cr empirically. 


AnctEer promising acceleration technigue is informed 

choice of starting vector. Note from (3.20) that choice of 
(0) 
MeaeLting vectcr XxX as nearly parallel to eigenvector i as 
possible wili cause small values of ner ee andmedm lier 
D 

ccnvergence cf the iteration method. Such an informed 
Choice must re based upon the physical situation nodelied 


and the anticipated properties of the final solution. 


Consider now an irreducible central-server modél as 
discussed in the proceding chapter. Perron-Frobenius theory 
tells us that the solution vector (to (3.1), (3.3) and 
(3.4)) is strictly positive; that is, all components nave 
positive values. As remarked in subsection 4.1, a choice of 
(ncnnull) starting vector with no negative components will 
guarantee convergence of the power method if the nodel is 
acyclic. In the case of the relaxed power method, any 
Nennegative starting vector will guarantee ccnvergence if 0 
<w< 1, and ina wider range of values for wif the model 
Mepacyclic. Theorems 3.11 and 3.12 indicate that more care 
Must be taken in the choice of a starting vector for the 


Gauss-Seidel method. However, a positive starting vector is 
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0 
Sufficient fcr all three methods. The starting vector zn 


T 
Sema)? = (1yn,1/n,-.«,1/n) is one such choice which is 


é€asy to implement. Of course, this is an arbitrary choice 
and consideration of the model parameters may lead to ktetter 


cheices. 


For é€xample, a product-form solution such as that 
discussed by Gordon and Newell [46] can provide a starting 
vector. Gaver [38] has investigated Gordon and Newell's 
fermulaticn for the central-server model with a single job 
type and expenential servers. For this case the 
steady-state probability tnat the system is in a given state 


| . aed Z JN 
1s proporticnal to ap ES ae where for each a = 


1,2,...,M4, Jm is the number of jobs at PPm in the given 


State and cr 1s the product of the service rate at the CPU 
m 


and the Eranching probability to PPm divided by the service 


rate at Frm. Since, in general, different job types have 
different service rates and branching probabilities, several 
States of a system such as those described in the proceding 
Saapter have J1 jobs at PP1, J2 jobs at PP2, ..., Jw jobs at 
PPM, and some technigue must be devised for developing a 
Starting vector from a product-form soluticn. One technique 
is to use ccrposite, or averaged, service rates and 
Meancning prcbabilities. Once the product indicated aLove 


has been determined, it can either be assigned to each state 


Maying Jm jocks at EPm (m = 1,2,...,4) or split among then. 
Jn Jin J2n ae 

Ancther technigue is to replace r by = oe where Jim is 
Mn m 


the numbez cf type-i jobs at PPm and r. is the product of 
in 
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the service rate of type-i jobs at the CPU and the branching 


prckability cf type-i jobs to PPm divided by the service 
rate of type-i jobs at PPn. 


Another example of how system parameters might be 
used to frovide a good starting vector is to base the 
relative values of the components of the starting vector 
upcn the fcllowing considerations: 

(i) If the service rates at the CPU are large as 
compared to those at the PP's, and if M is 
relatively small, there is a smaller likelihood of 
finding a large number of jobs at the CPU than a 
small number. The opposite is true if the service 
rates at the CPU are of the same crder as or 
smaller than those at the PP's. 

mmr) If the branching probability of type-i jobs 
to PEJ is significantly smaller than that of the 
Same type jobs to PPk, there is a smaller 
lixelihcod of finding a given number of type-1 
jobs at PPj than finding tne same number at PPk. 
fr1i) if the service rate of type-j jobs is 
Smaller than that of type-K jobs at a given 
processcr, there is a smaller likelihcod of 
BnGaging a type-k job in service there than a 


iaype-j cb. 


These guidelines are purposefully vague and no 
indication has been given as to how they might be used to 
develope a starting vector. The question of acceleration of 
the Gauss-Seidel iterative method, in general, and choice of 
mergood" starting vector, in particular, is an open area for 


resé€arch. 
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IV. PROGRAMMED MODELS 


This chapter 1s devoted to a discussion of three mcdels 
which have been programmed using the technigues develored in 
Chapter II. The programs have been written in FORTRAN and 
are currently operational on the IBM 360-67 at the Naval 
Meemereaduate School in Montery, California. In the first 
section the x2ucdels and programs are discussed. The second 
Section ccntains the results of a variety of numerical 
examples designed to contrast the models to each other and 
to approximate product-form solutions of some of the same 


proflems. 


1. DESCRIFTION OF MODELS AND PROGRAMS 


Tne first subsection of this secticn contains a 
discussicn of the models which have been programmed. The 
second subsection considers the similarities in the three 
prcgrams, and the final subsection considers their 


merrerences. 


All three models are closed central-server models as 
depicted in Figure 1.1. Service distributions at all 
processors are exponential. Two types of jobs ale 
considered, and service rates and branching probapiiities 


depend upcn jcb tyre. 
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The first model is the key example discussed in 
Chapter II. Each processor is a FCFS, single server queue. 
Hereafter, this model is called the FCFS model. Appendix D 
contains a listing of the FORTRAN program associated with 
this model. In the remainder of this chapter this progran 


Will be referred to as the FCFS progran. 


The second model is identical to the FCFS nodel 
except that the CPU has a PS queuing discipline. For this 
reason this acdel is hereafter cailed the PS model. A 
listing cf the associated programa, the PS program, is found 


in Appendix E. 


In the third model PP1 is an IS queue which services 
Only type-twe jobs (ALFA(1,1) = 0, to use notation 
introduced in the next subsection), and the CPU is a 
Multiserver FCFS queue. An application of this model wiil 
be discussed in section 3 of Chapter VI. In this 
application FP1 represents all of the tape drives ina 
computer system, and the multiserver CPU represents multiple 
CPU's with a ccmmon waiting line. Only type-two jobs 
require the use of tapes. This model is hereafter called 
the tapes model. A listing of the tapes program is found in 


Appendix F. 


Havirg introduced the models, attention is now 


directed toward the programs. 


1.2. Sigtilarities in the Programs 


The major variable names are common to the three 
prcgrams. Afrfendix G contains a glossary of these variable 
Names. Several are also defined in this subsection. Cthers 


have already been used in Chapter II. 
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The number, NPP, of FP's is an input parameter in 
mee three prcgrans. (In previous chapters this number has 
been represented by M, but in the programs it is NPP.) NPP 
ig restricted to be no smaller than two and no larger than 
Nine. The icwer bound is a natural restricticn in the tapes 
model (the tyre one jobs have to route somewhere when they 
ccenplete service at the CPU) and is necessary for 
irreducibility in the FCFS model. The upper bound is to 
help insure that the right subvector (see Chapter II, 
subsecticn 3.1) can be stored as a single-precision integer. 
This bound can te relaxed, but not withcut a careful 


reprogramning effort. 


The number, Ni, of type-one jobs and the number, N2, 
of type-twce jobs are input in all three programs. Both N1 
and N2 are restricted to pe nonnegative and their sum must 
net exceed nine. The upper bound is to insure that the left 
Sukvector (see Chapter II, subsection 3.1) can be stored as 
a Single-frecisicn integer. Together with the upper bcund 
On NPP, the upper bound for Ni + N2 insures that the right 


Sukvector can also be ¢o stored. 


The tapes program wili reject any case in which N1 = 
eens = 0. If Ni = 0, the FCFS program and the PS program 
Will decrease N2 by cne, increase Ni to one, replace the 
service rates and branching probabilities for type-one jobs 
by those for type-two jobs, and solve the problem as thougn 
there were actually two types of jobs. (The case in which 
Mee= 0 is treated similarly.) Because of this N1 + N2 is 
restricted tc be no smaller than two. The reader is 
cautioned, however, tnat out put referring to job type (for 
example, the probability that PP2 is busy with a type-cne 
jot) loses meaning when N1 = 0 or N2 = 0 initially. Note 
that any case in which there is only one job type can te 
Solved using a preduct~form solution. For the FCFS modei 


mie reader is referred to Gaver [38]. For the other two 
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models see Easkett, Chandy, Muntz and Palacios [6]. 


For €ach job type 1 = 1,2 and each PP, j = 
Sues, NEP, the branching probability, ALFA(i,j), cf a type 


meer tO PPj is also an input parameter. If, for some j = 


-6 
Sewers, NNE, ALFA(1,3) < 9.5 x 10 for both 1 = 7 and i 
= 2, then PF* 1s eliminated from consideration, the PP's are 
renumbered (if j # NPP), and NPP is decreased by one. NPP 


must satisfy the restrictions indicated above after all such 
-6 
memmng has taken place. If |ALFA(i,j)! < 0.5 x 10 for 


some 1 and j, then ALFA(i,j) is set equal to zero. If any 
ALFA(1,j) 1S negative, an error message is printed and the 


prcblem is nct solved. 


For each jcb type 1 = 1,2 and each processor j = 1, 

2, «--, NPP + 1 (processor NPP + 11s the CPU), the service 

mee, RATE (1,3), ct type 1 jobs at processor j 1S an infut 
=e 

Parameter. If any such rate is smaller than 0.5 x 10 , an 


error message is printed and the problem is not solved. 


Note that tests are performed in the order that the 
restrictions are presented here. Hence, a negative 
Meamening probability or service rate wili net cause 
Meecrtion cf the prcblem if the affected PP is eliminated, or 


if it is for type-one jobs and Ni = 0. 


Fach program is divided into a main routine and 
seven sukroutines: 
mms Controls flow or the program; contains read 
Statements for input; develops balance equations. 
CKOUT: Checks input parameters for adherence to the 
above restrictions. 
INIT: Steres the right and left subvectors and 
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asscciated pointer vectors. 
LOOKUP: Caiculates the state number from the vector 
representation. 


PIG: Calculates the number of combinaticns of n ¢ 
1 
_ things taken 7 at a time. 


GSSOL: Sclves the -talance equations. 

ERNTP: Prints the steady-state probability 
distributions (no more than one thousand states). 
ACCUM: Calculates and prints the measures of systen 

perfcrmance. 
Sukroutines PIG, GSSOL and PRNTP are the same for all three 
pregrams. CKCUT 1s the same in the FCFS and PS progrags. 
Although the coding differs in the tapes program, the same 


tests are performed in CKOUT of the tapes progran. 


The Gauss-Seidel iterative method, discussed in 
Subsecticn 4.3 of Chapter III, is used in GSSOL to solve 
the balance €quaticns. Each component of the starting 
vector is equal to 1/NSTATE, where NSTATE is the number of 
States (and talance equations). The method is considered to 


have converged if 


~1 -6 
oe xo J / coe < 0.5 x 10 


(4. 1) max |X. 
2 i 
ISLSNSTATE 
(o) (n= 1) 
where X. and X_ are the i-th components of, 
a a 


Cespectively, the n-th and the (n-1)-st generated vector. 


(n) (n) 
The solution method guarantees that X_ Ce se 
i i 


assumed tc be zero if it is calculated to be less than 
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2 7 (n) 
eo X 10 metneecire Case that X no genOye Tier Pidct ion if 
2 


Meee 1S set equal to zero if ee is zero or one if not. 
If convergence has not been attained in five hundred 
iteraticns cf the Gauss-Seidel method, a message is printed 
and the problem is aborted. The convergence criterion used 
here is, admittely, very stringent. However, it permits the 
luxury of not normalizing until convergence has been 
attained. All variables and calculations are single 


precision. 


fhe {nonoptional) output for all three programs 
consists cf the input parameters, the total number of 
states, tke number cf nonzero terms in the balance 
eguations, the number of iterations for convergence of the 
Gauss-Seidel method, and for each processor: the idle 
prcbability, the probability that it is busy with each type 
of job, the éeverage occupancy, and the average iength of 
Waiting line. Optional output includes the state vectcrs, 
the balance eguaticns and up to one thousand steady-state 


prckabilities. 


Having considered the similarities in the three 


programs, a discussion of the differences is in order. 


For the tapes program the number, MP, or CPU's (1. 
Methe number of servers at the CPU) is an input pararster. 
This numker is set equal to one if a nonpositive number is 
provided through the read statement. Note that the CPU can 
be made an irfinite server queue by setting the number of 
Servers equal to any number greater than or equal to Ni + 
n2. 
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fhe sequencing of the states is according to a 
lexicographic crdering of the ISTATEm1 vector 
representaticns for the FCFS and PS models and according to 
a lexicographic ordering of a slightly modified version of 
the ISTATEm2 vector representations for the tapes model. 

The modification used in the tapes model would list the jobs 
at PPi (necessarily all twos) at the right end rather than 
the left.end cf the left subvector. 


Moeadditicn to the nonoptional output indicated in 
1.2, the tapes program prints the average number of €ach 
type jok at each processor, the average number of CPU's busy 
with each tyre of job, the average number of CPU's which are 
idle, the distributicns from which many of these averages 
Mmencalculated (e.g., the distribution of the number of idle 
CPU's), and throughput for each processor. The throughput 
of a processcr is the average number of jobs completing 
service at that prcecessor per unit time. It may be 
calculated fcr a single server FCFS processor, for example, 
by multiplying the processing rate for eacno type job by the 
Mecrorticn of time the server is busy with that type of job 


and accumulating over all job types. 


2. NUMERICAL RESULTS 


Numerical resuits from utilization of the three prcgrams 
Meeenssed in the first section of this chapter are given in 
Mis secticn. The results given in the first subsecticn 
shew how the three models can to ways in which some of these 
models might be approximated by models be ccmpared for a 
Particular example. The second subsection is devoted 
Satisfying the conditions of local balance. The chapter is 
concluded with scme indicaticns of running times and core 


Tegquirements for relatively large jobs. 


a 





2.1. Use of the Programs to Examine Change 


Baskett, Chandy, Muntz and Palacios [6] considered 
the network depicted in Figure 4.1. The queuing discirline 
at the CPU 1S PS and eaca peripheral is a single server FCFS 
gueve. The rates for the exponential service distributions 
are given below the pox representing the corresponding 


processor (for example, ee is the service rate of type-one 
jobs at the CPU). Only the nonzero branching probabilities 


are given in Figure 4.1. Since each peripheral sees only 
cne type cf job, the system satisfies the conditions of 
local balance. Thus, Baskett, et. al. were able to use a 
Product-form solution to determine the utilization of each 
prccessor as the number of type-one jobs increased and the 
number of type-two jobs remained fixed at one. The idleness 
prcrabilities (one minus tne utilization) for the cases 
Teported by Baskett, et. al. are given in the first cclumn 
Of Table 4.1. 


Nete that this example is one which the PS model is 
designed to handle. The PS program was used to verify the 
Besults reported in [6] and to provide the average 
occupancies and throughputs as reported (for the same 
example) in the first column of Tables 4.2 and 4.3 


respectively. 


The FCFS program #as used to give the second ccluamn 
in these three tables. A comparison of the first two 
COlumns of each table reveais the effect of changing the PS 
Meu tO a FCFS CPU. Note that the differences become mcre 


Pronounced as the number of jobs increases. 
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Figure 4.1--Network of Baskett, et. al. Example 
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Since only type-two jobs are allowed to route to 
Bee, and Since only one type-two job is considered, PP1 is 
an IS queue and the tapes program can be used to determine 
the effect cf increasing the number of (FCFS) CPU's. This 
was done and the results are also reported in the three 
gatiles. 


Consider in more detail, now, the effect of 
Mepracing a FS CPU with a FCFS CPU in a model such as that 
depicted in Figure 4.1. Since the operations are exactly 
the same in the two models except when the system is ina 
State in which two or more jobs occupy the CPU, only these 
states will be considered. In the PS CPU each job receives 
service immediately upcn arrival. However, the rate of this 
service is degraded according to the number of jobs which 
Occupy the CFU. In tne FCFS CPU there is no degradation of 
Service. This fact supports a tendency toward shorter 
occupancy times (waiting time plus service time) for 
individual jobs and, therefore, greater taroughput for the 
FCFS CPU than for the FS CPU. However, this tendency is 
counterbalanced by the fact that jobs must wait in turn for 
setvice in the FCFS CPU, but receive service immediately in 
the PS CPU. This latter effect becomes dominant if the 
Service rates for one type of job is larger at the CPU and 
mre PPP's than that for the other type of job is at the CPU. 


Such a case is exemplified in the model by Baskett, 
et. al. (6] discussed above and depicted in Figure 4.1. In 
this example the service rates for the type-one jobs are 
larger at most PP's and much larger at the CPU than the 
Service rate tor type-two jobs at the CPU. [In tne PS aodel 
a type-one job arriving at the CPU after a type-two job 
Mgnt complete service at the CPU, receive service at cne of 
the PP's and return to the CPU several times before the 


type-two job leaves the CPU. In the FCFS model the tyfe-one 
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jok would be forced to wait for service until the type-two 
job left the CPU. As emphasized in the preceding paragraph, 
the effects of degraded service in the PS model are 
counterbalanced by the effects of forced waiting in the FCFS 
model. Hcwever, as can be seen in Table 4.3, the net 
result in the cases for which data are given is a decrease 
in throughput at the CPU when the PS CPU is replaced by a 
FCFS CPU. This results from a decrease in the throughfgut 
for type-cne jobs and an increase for type-two jobs, as can 
be seen by examining the throughput at the PPP's. From 
fables 4.1 and 4.2 it is also seen that idleness 
prcrabilities decrease at the CPU and PP1 and increase at 
PP2, PP3 and PP4Y, and average occupancies increase at the 
CPU and PE1 and decrease at PP2, PP3 and PP4. 


The difference in results between the PS model and 
the FCFS model increase as the number, Ni, of type-cne jobs 
increases, while the number of type-two jobs remains 
Bemstatn at one. The reason for this is that the 
degradaticn cf service in the PS CPU becomes less sericus 
for the type-one jobs and more serious for the type-twe job 
as the number of jobs at the CPU increases. For example, 
mmeeneone job of each type at the CPU, the rate of departure 
Meejops from the CPU is 9/2 for type-one jobs and 1/2 for 
type-two jobs. Increasing the number of type-one jobs to 


fcur changes these rates to 36/5 and 1/5. 


Finally, consider the effect of increasing the 
Number of (FCFS) servers at the CPU. Note that in those 
Cases in which the numbter of type-one jops is smaller than 
the number of CPU's, the CPU has an IS queuing discipline. 
From this point on, increasing the number or CPU's has no 
effect on the operation of the network. The reason that 
idleness probabilites in Table 4.1 continue to change fast 
this point for the CPU is that they were found by dividing 
the average number of idle CPU's by the total number of 
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CPU's. If each idle CPU has an equal chance of being chosen 
by a newly arriving job, this idleness probability is the 
Meoporticn Of time that each CPU is found idle. Since these 
IS CPU cases provide immediate, full service (as opposed to 
the delayed service of the FCFS CPU and the degraded service 
of the PS CPU) throughput is a maximum for all processors. 
Idleness probability is small and average occupancy large 
(relative to all other cases reported for the same job mix) 
Memene PFs. 


As the number orf servers at the CPU increases from 
one to Ni + 1, througnput at all processors increases. The 
reason for this is obvious at the CPU and nearly so at the 
me's: More servers at the CPU means more rapid return of 
joks to the FP's, resulting in a greater proportion of time 
Spent serving jobs. Similarly, the idleness probabilities 
at the PEF's decrease and the average occupancies increase. 
The result is a corresponding decrease in average occupancy 
and a resulting increase in idleness probability at the CPU. 
Note that in each case there is a point beyond which 
increasing the number of CPU's (that is, the number of 
Servers at the CPU) does not significantly improve the 
system. For example, with N1 = 7 there are no changes ia 
the measures of effectiveness (down to the third significant 
Seegat) fcr the PPts, and little change in those for the CPU, 
as the number of servers at the CPU is increased beyond 
three. The reason for this phenomena is that the PP's have 
become the bottleneck at this point. Judging from the 
results given in the three tables, increasing the number of 
CFU's beycnd two would probably not be justified if the job 
mixes given are representative of those which would be seen 


Dy the computer modelled. 
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2.2. Approximation by Local Balance Networks 


In this subsectidn consideration is given to ways in 
which a queuing network which does not satisfy the local- 
balance conditions might be approximated by one which does. 
The goal is to find an approximation whose steady-state 
Droperties are vary nearly the same as those of the original 
network. If such an approximation can be found, much time 
and effort cculd pe saved by taking advantage of the 


product-fcerm solution to the approximate model. 


Meeparticular interest is the FCFS mcdel discussed 
in secticn 1. This model does not satisfy the local-balance 
conditions because it contains at least one FCFS gueue at 
which jobs cf different types receive service at different 
rates. As can be scen from subsection 5.3 of Chapter I, 
the work cf Easkett, Chandy, Muntz and Palacios [6] 
indicates that local balance would prevail if the queuing 
discipline at these queues were PS, IS or LCFSPR rather than 
FCFS, or if the processing rates were the same for the two 
jcb types at each FCFS processor. These observations will 
form the tasis for most of the approximations discussed 


here. 


Reviewing the example of Baskett, et. al. expanded 
pen in subsection 2.1, it is seen that replacing the FCFS 
Maeby either an IS or a PS CPU could lead to significant 
differences in the measures of system performance (see 
Maples 4.1, 4.2 and 4.3). The reason for this is that the 
Capidly-mcvirg type-one jobs must at tines wait at the FCFS 
CPU for the slcw-moving type-two jobs to complete service. 
In the IS CPU there is no interference between the two types 
Bie jobs. In the FS CPU there is interference in the form of 


degraded service, but the extreme difference in service 
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rates makes this interference considerably less severe than 
Miat in the FCFS CPU. 


If the FCFS CPU were replaced with a LCFSPR CPU in 
the same model, scme interference of the type encountered in 
the FCFS CPU would occur. The completion of service of any 
type-one job at the (LCFSPR) CPU, whether the type-one job 
was enqueued or in service when the type-two job arrived, 
would necessarily wait until the type-two job had completed 
its service. However, the high service rate of the tyfe-one 
jorks at the CPU as compared to their rates at the PP's makes 
Mme Probability that the type-two job will catch one or more 
type-one jots at the CPU when it arrives rather small. On 
the other hand, the chances are good that the type-two job 
Will be interrupted (perhaps, several times) while at the 
CPU. The anticipated result is an increase in idleness 
prcbability and a decrease in average occupancy and 
throughput at PP1 and the reverse of this at PP2, PP3 and 
PP4Y. These facts are easily seen to be true Since a careful 
reading of [6] reveals that the idleness prcbabilities, 
average cccupancies and throughputs for this example are tne 
Same whether the CPU has a PS queuing discipline or a LCFSPR 
queuing discipline. That is, "PS" in Tables 4.1, 4.2 and | 
meee cOUid be replaced by "LCFSPR." 


So it is seen that Simple replacement of a FrCFS 
Meecessor by a PS, IS or LCFSPR processor with the samé 
Service distributions may result in Significantly different 
Values fcr the measures of system performance. It may be 
possible to arrive at better approximations by also changing 
the service distributions (for example, by adjusting the 
Service rates). However, the types of changes to make are 


mot obvious if the queuing discipline is also changed. 


In [6] Baskett, et. al. investigated an 


approximation to the above model in which the two classes of 
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Mees acre Leplaced by a single "equivalent" class of jotks. 
For each value of N1 they retained the given service rates 


at the PP's and replaced the service rates at the CPU ky 


42 ie > fG 18 + 
( ) 5 (qd, i.) / (q/ 1s ye 


and the branching frobabilities by 


4.3 - * > 
(4.3) Bo (gp 5 1P,,) “ sey q,) 


mere g is the rate at which class i jobs leave the CFU. 
i 
These rates are determined from the solution of the original 


mcdel. These cheices for the rate at the CPU and the 
branching probabilities for the "equivalent" class of jobs 
are reascnable since they are the values for the parameters 


Which wculd actually be measured. 


Since the resulting network is a central-server 
model with a single job type and single-server exponential 
gueues, the work of Gaver [38] applies (see subsecticn 4.2 
of Chapter I). That is, the joint steady~state probability 


Merrnding n jobs at the i-th PP (where eS + ae + oe +28 
i 
is less than or equal to the total number of jobs in the 


System) is proportional to the product over iof R_ raised 
al 


to the n_ pcwer where R = et ae jamie h the choices, of 
zt al 


sL a 


meaep given in (4.2) and (4.3), respectively, R, is the 
iL a 
Meio of the utilization of the i-th PP to the utilization 


of the CPU. This same result generalizes to the less 
Specific FCFS model in which both job types are allowed to 


Visit each processor. 
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The fact that the exact results from each case (that 
is, each job mix) must be used to derive the parameters for 
the approximate model makes this method of dubious value. 
The exact model must be solved (cr measurements taken on the 
System represented) in order for the parameters of the 
approximate model to be determined. If the queuing 
M@ecciplites, service rates, branching probabilities or job 
mix changes, these parameters must be recalculated frog new 
measurements. They cannot be determined from the parameters 


of the exact nodel directly. 


Besides this Baskett, et. al. showed that 
Significant differences can exist between the results given 
by the exact model and those given by the approximate model. 
The author has had similar experience in applying this 


method to a variety of two-PP FCFS models. 


An area which is still open for investigation is 
approximation of, for example, the FCFS model by a model in 
Which the branching probabilities are the same but the 
Service rates for jobs of different classes are replaced by 
a Single service rate at each FCFS queue. The work of 
Baskett, et. al. in [6] could then be used to determine the 
measures cf system performance in the apprcximate model. 
Perhaps, with the aid of the FCFS program an appropriate 


Chcice fcr the composite service rates could be determined. 


2.3. Specifications for iarge Jobs 


Pr -——t +a 


In this final subsection attention is focused cn the 
Cunning time and core requirements of some large jobs. With 
common values for system parameters (N1, N2, the service 
tates and the branching probabiiities) the FCFS nodel 
Pesuits in more states than either of the other two nodels. 


The PS gueuing discipline at the CPU in the PS model and the 
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multiserver at the CPU and infinite server at PP1 in the 
tapes model reduce the size of the state space from that 
experienced in the FCFS model. In addition, despite the 
fact that more nonzero entries are required per row in tae 
rate matrix (COEF) for both the PS model and the tapes 
model, the reduced state spaces in these models result ina 
reduction in the totai number of nonzeros in large cases. 
As a result the primary concern here is the requirements of 


moe FCFS frogran. 


A FCFS model with four jobs of each type (N1 = N2 = 
4) and two PP's (NEP = 2) resulted in 3150 states and 10080 
nenzeros in the rate matrix. Dimensioning the state 
precbability array (P) and the three arrays used for stcrage 
of the balance equations (NCON, INDEX and COEF) accordingly, 
the program required 164K bytes of storage on the IBM 360-67 
ccmputer at the Naval Fostgraduate School in Monterey, 
California. The service rates used in this model were 0.6, 
Beeeeand 0.9 for type-one jobs and 0.8, 1.0 and 0.5 for 
type-two jobs at the CEU, PP1 and PP2, respectively. The 
Branching proktabilities were 0.55 and 0.45 for type~one jobs 
Meeoss0 and 0.70 for typea-two jobs. Convergence was 
attained (using the rather stringent criterion described in 
Bection 1) in 187 Gauss-Seidel iterations. The total 


execution time for the program was 212.13 seconds. 


A seccnd case using the FCFS model with Ni = 2, N2 = 
5 and NPP = 4 resulted in 6930 states and 35280 nonzeros in 
mie rate matrix. Dimensioning P, NCON, INDEX and COEF 
accordingly, the problem required 396K bytes of storage. 
Mie Service rates used were 10.0 for type-one jobs and 71.0 
for type-two jobs at the CPU and the reverse of these at 
Sach peripheral processor. Branching probabilities were all 
-25 regardless of job type or PP. Convergence was attained 
ma206 iterations. The program required 527.05 seconds of 


mxecution tine. 
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The PS model was also run uSing the parameters of 
this seccnd example. The result was 5754 states and 30464 
nonzeros. The dimensicns of the FCFS model (6930 and 35280) 
were used in this model and, because of differences in the 
pregrams themselves, this resulted in a requirement for 398K 
bytes of storage. This figure could have been reduced by 
dimensioning P, NCON, INDEX and COEF according to actual 
requirements. Convergence was attained in just 32 
iterations. The program required 98.63 seconds of execution 
tire. The measures of system performance reported in Table 
4.4 for these two models again point out the extent of 
rossible error when a FS CpU is assumed to be a FCFS CEU, or 
visa versa. In this particular comparison type-one jots are 


"PP bound" and type-two jobs are "CPU bound.! 


Although the number of iterations required for 
convergence cf the Gauss-Seidel technique for solution of 
the balance eguations generally increases with the numter of 
states, wide variation exists in the number of iteraticns 
required for a problem with a given number of states. 
Indeed, the author has examples of cases with only 30 states 
requiring more iterations than the 5754-state case reported 
in the preceding paragraph. This should not be too 
Surprising. AS pcinted out in Chapter III, the number of 
iteraticns required for convergence depends upon the 
Magnitude of the nondominant eigenvalues of the rate matrix. 
The eigenvalues of any matrix depends upon each and every 
entry in the matrix. Changing a single value in the matrix 
Will, in general, change all of the eigenvalues. Thus, 
little hcpe is seen for being able to predict the number of 
iteraticns required, or the running time, based upon the 
System parameters. The running time can be reduced by 
Medaxing the convergence criterion. Since the real items of 
interest are the measures of system performance, such as 
idleness frokabilities and average cccupancies, changes in 


these quantities could be used as a basis for determining 
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TABLE 4.4 


SGMPARLTOUN OF FCFS 


CASE IN WHICH NPP 


Number of States 


Number cf nonzeros 
Pm face matrix 


CPU idleness probability 
PP idleness probability 
CPU average occupancy 

PP average occupancy 
CPU throughput 

PP thrcughput 


= 4, 


AND PS PROGRAMS IN A 


N1 = 2 AND N2 = 5 
eCFs_Program Ps Pro 
6930 Dil 
35280 304 
-000197 -000 
-890 0 
6.438 Tae 
2144 4 
1.308 2000 
57 55 


Note that performance at the four PP's is the same. 


figures réperted here are for each PP. 


2a 


64 
920 
a6 
73 
a 
14 
O04 


The 





convergence. Unfortunately, any savings which might be 

realized by decreasing the number of iteraticns in this way 
would be diminished by the time required to calculate these 
Measures at €ach iteration. In many cases the result may be 


a net increase in running time. 


Ccmparisons of the ccre requirements and running 
time with these reguired by other possible solution methods 
are difficult at best. None of the examples presented here 
were run cn a dedicated machine. Because of the effects of 
other jors in the system, rerunning these same jobs would 
likely result in different execution times. Although the 
author was "core conscious" in programming the models, there 
are probably still ways in which core usage could be 


reduced. 


In general, the follcwing statement can be made. If 
a product~-form solution exists, running time is bound to be 
Sherter fcr a program designed to take advantage of it. The 
reason is that no iterations are required, and it is nct 
necessary to generate and store the balance equations. Even 
in such cases, however, some of the concepts and techniques 
developed in Chapter II may be helpful in generating all 


States without duplications. 
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Software monitors, or system jobs, are used in most 
large-scale, multiprogrammed computer systems to provide 
data concerning performance of the system and usage of the 
system by individual user jobs. In this chapter some 
possible sources of bias in the data provided by such 
monitors are investigated. Modelling the computer system as 
a closed central-server system, two types of software 
mcnitors are examined. In each case a methced is presented 


which will Pecd Grmcne Dias in the monitor. 


Consider a situation in which a céentral-server model is 
developed for an existing computer system, and a software 
monitor is used to collect systéem~performance data in crder 
to validate the model. The results of this chapter could be 
used to explain differences between model results and 
monitor results. The question of correcting monitored data 
for bias is not addressed here. This remains an open 
guestion which has apparently not been considered in the 


open literature. 


7. THE PROBLEM 


One of the majcr problems in modelling real systems is 
monitoring the system so as to collect the data necessary to 
estimate the parameters used in the model. The same problem 
atises in validation of resulting models where system 
performance must be monitored for comparison with model 


predicticns. 
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For ccmputer systems two types of monitors are generally 
available. Hardware monitors are external devices which, 
when attached to various processors, determine the activity 
at the prccessors by measuring passage of electrical current 
and changes in electrical potential. Software monitors are 
internal devices, or system programs, which use computer 
precessing capabilities (CPU time and memory) to collect 
data. Individual frogram accounting data (used as a basis 
for charging system users) are one class of data collected 


using software monitors. 


Software monitors, in using computer resources, somewhat 
degrade the resources available to users of the system. For 
example, system prcgrams require storage (often in core), 
degrading the amount of storage available for very large 
user programs. They also reguire processing time and 
therefore increase "turnaround time" for users programs. 
These are usually not serious problems, and software 
monitors are generally much less expensive and more flexible 
than hardware monitors. This, plus the fact that it is 
extremely difficult to differentiate between individual 
programs with a hardware monitor, makes the software 
monitors the most likely choice for data collection, whether 
for accounting data, model-parameter data or nmodel- 


validaticn data. 


In this chapter models of two types of software monitors 
are discussed. A possible source of bias in the data 
collected by such monitors is analyzed. Throughout the 
Chapter the computer system under consideration is modelied 
as a closed centrai-server network of queues as pictured in 
Figure 1.1. This model is assumed to be an accurate 
representation of the system, and steady-state probabilities 
(assumed to exist) calculated from the model are therefore 
also assumed to be accurate. The purpose of the sortware 


mcnitor in each case is to determine system performance by 
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observing this probability distribution. A model of the 
mcnitor is used to determine the distribution "seen" by the 
monitor sc that comparison may be made with the "true" 


distribution and bias determined. 


In secticn 3 consideration is given to a monitor which 
briefly cccupies the CPU and determines the state of the 
system each time a job leaves the CPU. In section 4 the 
monitor enters the system infrequently, waits for a free 
server at the CPU, then briefly occupies the CPU and 
determines the state of the system. In both sections the 
problem is analyzed for a Jackson-type network (as described 
in secticn 2) and then extended to more general cases euch 


as those discussed in Chapter II. 


Meee inde FASIC MODEL 


The scftware-monitor models discussed in sections 3 and 

4 will be analyzed extensively in terms of the closed 
central-server model depicted in Figure 1.1 with the 
fcllowing assumptions: 

(i) Each queue is a single-server, exponential 

queue with constant service rate and infinite 

Sapacity. 

(741i) Only one type of job circulates in the 

SyYStEel. 

(iii) Branching probabilities are constant. 
Under these assumptions the gueuing network under 
consideration is called a Jackscn netwerk (the term is 
borrowed from Melamed, Zeigler and Beutler [80]) in honor of 
J. R. Jackson [56] who first exhibited a preduct-forn 
solution for the steady-state probabdility distribution of 
Mee models. Before examining this solution, consider the 


balance equations which the solution must satisfy. 
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The model described here is a continuous-time, 
finite-state Markov process which is also irreducible. 
Hence, the steady-state probability distribution exists and 
can be determined by solving a set of balance equaticns 
together with a normality condition. (See Feller [ 32]}.) 
Derivaticn of the balance equations through limiting 
arguments and the Komoigorov differential equations is a 
standard exercise in such cases and is therefore omitted. 
(See section 3 of Chapter I.) Direct development of the 
balance eguations will follow the introduction of some 


notation. 


bet N denote the total number of jobs circulating in the 
system. The M + 1 processors are numbered sco that processor 
1 is PPi for 1 = 1, 2, ..., M and processor M + 1 is the 
CPU. The service rate at processor 11S r. and the 
at 
Memening prckability (from the CPU) to PP1 18S b. By the 
aL 


Markov-like assumptions, a state A is completely specified 


by a listing of the number of jobs at each processor. Thus, 


Manin 4D gee gh ) where for each i = 1, 2, «.-, Mtl, n- 
i 2 M+ 1 ah 


is the number of jobs at processor i when the system is in 


state A. Note that a + eS ty S35 gas = N. Also note 


n 
M+1 


that every vector (n Bete 4 of nonnegative integers 
+ 


which sum to N represents a valid state. 


For any state A= (n ,Nn ,-..,2 ee ee ecie mere tne 
12 ules 4 ass 


State with i-th component increased by one and j-th 
Memoonent decreased by one; e. g-, A, = 
13 
Meetee st + lec e. yl ~lyeewa yl Ree So is2e SINCCmn, 1S NOt 
1 Bt 5 Bice ij 
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a valid state if n = 0, any statement containing, for 


example, the probability of A will have that probability 
1) 
multiplied by g(n ) where 
3 


- ; 1 wien. >. 0 
2 h = 
( (n) 0 Pe one <--0 


so that a large variety of special cases need not be 


considered tc handle such "non-states." 


For each state aA, P(A) will denote the steady-state 
probability that the system is in state A. 


Let A= (mn ,Q ,...,f ) be any state. To develop the 
i 2 M+1 


kalance e€guation associated with state A, note that: 


(1) The rate of transition out of state A (given 


the system is in state A) is given by 


M+4 
(>. 2) RCA ee (ee 
ee 3) 
j=) 
(11) The rate of transition from state A ince 
j, M+ 
state A (given a > 0 and the system is in state 
4+ 
A )) ci aee 
J, M+ J 
(iii) The rate or transition from state A 


M+1, 5 
micomstate A (given n > 0 and the system is in 
State A |) CDS) oe ° 

Mad a) ieee 


(1v¥) The states A and A Bm 2Of 1 > 1727 
gles G41, 5 
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---, M are the only states from which the systen 


can transition in one step into state A. 


Thus, the kalance equation associated with state A is 


5. 3) R(A)P(A) = gin. |.) Sc P(A. ) 
M+1 5 aot 


+ ODO bE n )P(A 
- j eae fy ( Med, 7 
= 


Using Gordon and Neweil's {46] formulaticn of this 
problem, Gaver {38] has determined that the solution is 


given by 
M om 
0 ee 
(5.4) P(A) = K TT a 


al 


where K is a ccenstant which insures that the appropriate 


Sertality condition is met and, for j = 1,2,---,M, Gg. = 
i 
Dm I ft . Note from (5.4) that 
j M+1 5 
(5.5) a = ode 2 (4) 
Niet J 
and 
(5.6) P(A eats) 7 
ue a J 
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3. THE EVENI-~KEYEL SOFTWARE MONITOR 


Now ccnsider attempting to monitor system performance by 
means of a scftware-monitor job, hereafter called the 
observer, which briefly occupies the server at the CPU each 
time one cf the other N jobs completes service at the CPU. 
While at the CPU, the observer counts the number of joks at 
each of the M + 1 processors. The time it cccupies the 
server is assumed to be exponentially distributed with mean 
e so small that the disturbance to system operation is 
minimal. In fact, e will be allowed to approach zero so 
that the possibility of a change in the state of the systen 
while the observer 1s cccuping the CPU can be ignored. [In 


anticipation of the limiting operation assume that 


M+ 1 
(5.7) Wee > a7 


The observer is not numbered among the N jobs in the system. 


Note that since the observer 1S served at the CPU cnly 
when a jcb ccmpletes service there and routes to one of the 
PP's, and since no transition is allowed while the cbserver 
is at the CEU, the state in which all jobs are at the CPU 
cannot be observed by the observer. For example, if N = 1, 
the observer will always see the CPU idle. Hence, it is 
clear that scme bias may exist in the system performance as 
reported by the observer. The objective here is to 
determine this bias. Since no measures of system 
performance have been specified the approach will be tc 
determine a computationai method for caiculating the 
Steady-state distribution seen by the observer in terms of 
the “actual” steady-state distribution as specified in 


(5.4). From these two distributions the same measures of 
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system performance may be calculated and compared. 


The difference between the model discussed here and 
the one discussed Desc eceELTon 2 1S the introdtction of the 


observer. Corresponding to each state A of the earlier 


* 
model is a state A which has the same distribution of the N 


jobs among the M + 1 processors but also has the observer in 
the system, This can be depicted in vector notation by 
addition cf an (M+2)-nd component having vaiue one if the 
observer is in the system and zero if not. That is, tke 


state eee 8 9) has n_ jobs (exclusive of the 
“ J 


hee 
observer) at processor j for j = 1,2,...M+1 and has a total 
or 0 + n jobs (including the observer) at the CPU. By 
M+1 M+2 
convention the state name will by "starred" if n ; = 1. 
M+ 
x 
mess, If A = (nN JgN geeeyN ,O), then A = 
in 2 M+ 1 
| ee ol i. 
( Val a . M+1- ) 


Since the system is different, the steady-state 
@mstribution determined in section 2 will not hold. 
(Indeed, this new system has twice as many states.) So, 
consider the Ealance equations for this new system. The 


steady-state probabilities are denoted by P indicating a 
= 


dependence upon the value of e. 


Consider first an unstarred state A = 


re ol MOV er ne Late Of transition from state A, 
2 M+1 





R(A), is easily seen tc be specified by (5.2) and to be 
independent of e. The transitions described in (ii) are 
still valid, but those described in (iii) are not possible 
Since the observer enters the system whenever a job leaves 
the CPU. However, a transition into state A occurs when the 


observer leaves the system if the system is in state A 


Thus, the talance equation associated with A, to be compared 


Meen (5.3), is 


M 
x 
(5.8) R(A)P (A) = g(n |) Sxc_P (A. ) + P (A )/e 
<€ M+1 1 = 


i 


x 
New consider a starred state A = 


ae Mies a, DD 1). Since the observer (and not one ofr the 


2 M+1° 
N jobs) is in service at the CPU, 


M 
* 
(5.9) R({A ) = 1fe + 3 xr p(n) 
2 J 
daa 
ok 
Note that R(A ) does depend upon the value of e. In fact, 
x 


meq>.7) R(A) = 1fe approximately. The transitions 
pd 
described in (iii) are valid with A replaced by A. Those 


described in (ii) are similariy valid so iong as the A. aN 
Je 


P- 4 
is replaced Ly a . Thus, the balance equation 
j, +1 


* 
associated with A (compare again with (5.3)) is 


PET 





M 
ae x 
(5.10) Poems j= ein ) Sc P (A 
< M+ 1 


tb L ale ee er 
aes mea? | = a pes 


Fefore proceeding further with the analysis, 
consider its goai: to determine the bias introduced by the 
observaticn method. This is to pe done by caiculating the 
steady-state probability distribution seen by the observer. 
But this distribution is the conditional stéady-state 
prcbability distributicn given that the observer is being 
served by the CPU. That is, the desired result can be 
determined by finding a solution to (5.8) and (5.10) and 


renormalizing the probabilities of the starred states, 


* 
{P (A )}. In principle, this can be done by applying 
S 


solution technigues such as those discussed in Chapter III. 
Eut (5.7) makes this a comptuationally unsatisfying thing to 


do. Alsc, the following analysis makes it unnecessary. 


Pimearivang (5.0) through by e€, notice that 


M 
ke 
1 = - Ser PA 
(5.11) at. ) See) Fy aay” a j,uer 
= 


Since R(A), rand g(n ) are all independent of e and 
J lag 


= 
) are bounded above by one, P (A ) 
2 


Since P (A) and P (A 
e ns eae 


approaches zero as e approaches zero. 
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ToMeisliG tI. 9) if (5.10): 


M 
* ss * 
fee 12) F(A )/e = Sr{sg(n P (A) + g(n  )P (A- ng 
¢ J TG ate aj ganas 
5 ae, 
M 

ed es Ane aren ) 
j M+1 Se yee ho 
i oe 


Memeeeccsuit cf (5.11), it is seen that (5.12) leads to: 


M 
* 
fe. 13) lim P (A €é= > br n)P (A 
a a cee aor? | ;) o | ‘ona 
e=—2>0 j= 1 


Using this result to determine the limit in (5.8): 


| 

SB. 14 R(A)P (A) = n De eee © \ 

( ) (A) 9 | ) © ( wey 5 os 4 Kee 
1= 


HE 


mg oes n)P (A 
_ mee ,’ a noes 
= 


Ccmparing this with (5.3) note that (5.14) are the balance 
equations for the system described in secticn 2. These 
results should not be too great a surprise. They say that, 
as the méan time the okserver is in the system approaches 
zero, the prokability of finding the observer in the systen 
approaches zero and the probability of finding the system in 
a state whick does not include the observer (an unstarred 
State) approaches the probability of finding the system in 
that state if the chserver does not exist. This limiting 


@eetributicn is given by (5.4). 


Now define a function of the state space of the 


Mmaesic model descrited in section 2: 
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xe 
i. 15) n(A) = dlim P (A )/e 
= 
e-->0 


ae 
Meee that h({A) = P (A )/fe + Of(e) so that the h(A)'s are a 
e 


* 
Mmeomed VErTSicn of the P {A )'s. That is, the limit (as e 
€ 


approaches zero) of the conditional distribution may be 


found by normalizing the h(A)'s. Now using (5.13), (5.6) 
and (5.2) yields 


4 


(5.16) h (A) g(n_)P(A ss) 


Dp? 
peee eA : M+1,j 


SECA) > D E O(n )/g. 
ett 5 3 


He < 


= F(A) 3 rain ) 
J J 
j= 


= P(A)[R(A) - © g(n )] 
M+1 M+1 


Using (5.16), h(A) can be determined from the true 
distribution (the P(A)'s) and the system parameters, 
Normalizing yields the distribution. The desired measures 
of system performance may then be calculated from both 


distributions and the results compared. Note that if A= 


Mime, ¢.200,D ) where n =n =... =n = 0 anda = 0, 
| +1 1 2 M M+2 


That 1s, this state can 


Il 
© 
i 


then R(A) = r and h (A) 
M+1 
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never be cbserved by the observer. 


3.2. Generalizations 


Consider an arbitrary closed network of M + 1 queues 
and N jobs circulating among them. From among the queues 
designate one the CPU and the others the PPP's. Sequentially 
number the gueues so that queue M + 1 is the CPU. Now 
suppose that each state of the system may be represented as 
a vector of integers and that, so designated, a finite 
system of balance equations may be found which are satisfied 
by the steady-state probability distribution for the states. 
That is, assume that the system is modelled as a finite 
state, continuous time Markov process. Examples of such 
medels are fcund in Chapter II of this thesis as well as in 
Baskett, Chandy, Muntz and Palacios [6] and Kelly [53]. 
Assume further that the steady-state distribution is known 


(or can ke determined). 


For convenience, also assume that two or more cr the 
following three types of transitions may not occur 
Simultaneously: 
(i) transitions resulting from one or more jobs 
leaving the CEU destined for the PPP's; 
Peepecransitions within the CPU (e.g., a job 
changing from one stage of service to anctheL) ; 
(iii) transitions within and among the PP‘s and 
Eoom the PP*s to the CPU. 

For each state A define three subsets of the state space: 


af) = {B in state space | a single step 
transition can take place from B to A as 


specified in (1)} 
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2) = {B in state space | a single step 
transition can take place from B to A as 


Specified in (ii)} 


Be 3) {B in state space | a single step 


transition can take place from B to A as 
Specified in (iii)} 
™ 
Because of the assumptions concerning occurrence of 
Simultaneous transitions, if a single step transition can 


occur from scme state B into state A, then B is in exactly 


one of Ea): oa, and oe The palarce equation 


associated with any state A can be written as: 


(5.17) R(A)P(A) = > r(3B,A)P(B) + Ee Vela Ua, 
BEC (A BEC (A 
na ) 5 ) 
+ > r(B,A)P(B) 
BEC (A) 
S 


Where P(A) is the steady-state probability that tne systen 
1s in state A, r(B,A) is the rate of transiticn from state B 
to state A given the system is found in state B, and R(A) is 
the total rate of transition from state A given the system 
is found in state A. In analogy with (5.2), R(A) may te 
@bacten aS a sum of r(A,B) over all states B into which the 


System cculd transition fron state A in one step. 


Now consider a software monitor, again called tne 
observer, which enters the system each time a transiticn 
Becurs in which one or more jobs leave the CPU destined for 
the PP's. Again assume that the service distribution for 


the observer at the CPU is exponentially distributed with 
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mean e. Alsc assume there is only one observer, so that a 
second one cannot enter the system if another transition as 
described in (1) occurs while the observer is at the CEU. 
Furthermore, assume that the observer cannot be preempted, 


cannot be blcecked, and is subject to no bulking. 


As in subsection 3.1, use a star to denote presence 


of the ckserver in the system. Except that P {A) will 
= 
denote the steady-state probability that the system is in 


state A, the notation introduced earlier in this subsection 


2 x 
Will be adhered to. Note that r(A ,B) and R(A ) are 


xx x ox 
dependent upcn e, though r(B,A ) and r(B ,A ) are not. 


x 
Also, let £(A ) be the rate at which the system transitions 


* 
out of A by having tne observer complete service at the CPU 


and leave the system (given that the system was in state 


x x 
A). For many gueuing disciplines, f(A ) = 1/e. For the PS 
-1 
discipline £(A ) = fLe(n +1) ] where n is the numter of 
CEU Cru 


a 
joks at the CPU in state A exclusive of the observer. 


x 
Assume that £{A ) increases without bound as e approaches 


x 
Meo. Recogrizing that A may not be a valid state for all 


* x 
m@etarred states A, define P (A) = 0 if A is not valid. 
e 


(For an example of such a case, suppose the CPU is a single 


server, FCFS queue with generalized Erlangian service 
distributions and consider a state A in which the job in 


Service at the CPU is in its second stage of service.) 
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The Falance equations for the system containing the 


observer are given by 


= s 
(3. 18) eee) Eat) = r(A a) + Pease) Pace) 
= 
BEC (A 
5! ) 
+ PAE) 12) (2) 
= 
BEC (A 
3 | ) 
* 


mmemeecor all A such that A is valid, 
¥ * x 
i>. 19) ma )P (As) = S c(B,A )P (B) 
= e 


x 
BEC (A ) 


% x > 
+ > E(B yA) Eats ) 
€ 


~ «x x 
+ 2 e (US ue) sis 
e 


x x 
BeC (a 
ah ) 


x 
Lividing (5.18) by £(A ) and passing the limit as 2 
x 
mees CO ZEIc, note that ? (A ) also goes to zero. Since 
= 


* x 
R(A ) is the sum of £(A ) and rates which are independent of 


x * * x 
@, R(A )P (A ) and £(A )P (A ) have the same limit as ¢ 
€ 2 


ae * x 
approaches zéro. Since r(B,A ) and r(B ,A ) are independent 


Mee, this limit is deternined from (5.19) to be: 
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x * x 
(5.20) mech) (A) ese gs )P (3) 


€ 
e-->0 * 
BEC (A ) 


TI 
M 


Manmang the limit in (5.18) and using (5.20), the result is 
seen to be the same as (5.17) so that Bea and P(A) are the 


Same. The reason this is true is: 


* x 
(ey if A is valid, B € Bes ) iff the systen 


x 
transiticns from B to A by a departure from the 


CPU. That is, if there were no observer, B would 


be in Sey 


te 
(li) If A is not valid, the system cannot 
transition into A by a departure from the CPU even 


Mr there were na observer; i.ée., an) is empty. 


Define a function, h, of the state space of the nodel 


Without the ckserver by: 


(5.21) h(A) = > x2 (B,A)P(B) 
BEC (A) 


Note that normalizing the na(A)'s yields tne distributicn 


x 
seen by the cbserver if (and only if) £(A ) is constant for 


xe 
Meyen © as a function cf A (such that A is valid). This is 


te 
Eve in the many cases in which £(A ) = 1/e, but is not true 


in the case the CPU has a PS queuing descipline. However, 
Mmmethat case the desired result is obtained if (5.21) is 


replaced ty: 
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(5.22) h(A) = (n =) De (Usa ty 


BEC (A) 


xk 
Since the term involving e in R(A ) is 1/Le(n ald de Note 
CP 


 * 
meter A is not valid, the sum in (5.21) and (5.22) is 


vacuous and h(A) = 0. That is, such states cannot be 


observed Ey the observer. 
feeds GASTY AND INFREQUENT OBSERVER SOFTWARE MONITOR 


Suppose ncw that system software is monitored by means 
of a softwaré-monitor job which enters the systen 
infregquently, waits for an available server at the CPU, 
briefly cccurpies the first availiable server, hastily ccunts 
the number cf jobs at each of the M + 1 processors, and then 
leaves, cnly to return much later. This monitor job is 
hereafter called the hasty and infrequent observer, or HIO. 
Assume that the service times for the HIO are exponentially 
Gistributed with mean e and that times between visits to tne 
System (i.e., frcom the time it leaves the system until it 
next enters the system) are distributed exponentially with 
mean 1/w. The bias is examined in the limiting case that e 
Meadow both approach zero. Though it is not necessary to do 
Meee the case in which e/w = 1 can be borne in mind. The 


approach is similar to that exhibited in section 3. 
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| Consider introduction of the HIO into the Jackson 

model introduced in section 2. AS in subsection 3.1, adda 
component to the state vector and give it a value of one if 
the HIO 1s ir service at the CPU and zero if the HIO is not 
in the system. In contrast to the observer discussed in 
section 3, the HIC can be in the system but net in service. 
This case will bre denoted by a two in the (M+2)-nd component 
Memeeme Vector . If A = (NM ,N geoegd ,0) 1s a State, then 

ey a M+1 
* * 


Memes A = (Nn gM geee,gN pl) and, Df 1 > 0, so is A = 
ah “22 M+ M+ 1 


Mime yo ee gD poe Loaeenetation A 9, R(A) and g(n) will 
| M+1 sh 


have the same meaning it had in subsection 3.1. Again, 


P {A) will be the steady-state probability of state A in the 
e 
system containing the HIO. P (A) is dependent upon both e 
- 


and w, even though the notation does not contain the w. 


Ccnsider any state A = (BO 0 Oe! Ot 2 hice 


nN 
M+1- 


System may transition from state A by 


(i) havirg a job complete service at one of the 
Pe'’S and coute to the CFU; oF 
(ii) having a job complete service at the CPU and 
moute tO cne Cr the PP'S; OF 
(iii) having the HIO enter the systen. 
Maus, the total rate of transition from state A, given that 


the system is in state A, is: 
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M+1 
fe. 23) R(A) = > cr p(n ) + w 
4=1 J J 


* 
iaestare Al the HiO 21S 1n service at the CPU. fhus, 


a transition ty (i1) has rate 1/2 and a transition by (iii) 


is impossible. As a result, the total (conditional) rate of 


x 
meansiticn fricm state A is: 


M 

a 

(5.24) R(A) = 3 rg(n.) + 1/e 
J J 


j=1 


sibs = 0 and the HIO enters the system, 1% 


n 

¥+1 
immediately receives service since the CPU is idle. Thus, 
# 


i 1 = 0, A is net a valid state. So, suppose that n 
+1 M+1 
> 0. Then, Since the HIO is in the system, (111) dces not 


Meeey and the total (conditional) rate of transition fron 


Brate A is: 


: M+ 7 
i. 25) R(A ) = 3 cr O(n.) 
421 J J 


These three equations should be compared with (5.2) 
which gives the total (conditional) rate of transition from 
State A if the HIO does not exist. Note that as w 
Mepcoach<es zero, R(A) from (5.23) approaches the resuit from 


oe 
(5.2). Also, eR(A ) approaches one as e approaches zero. 


Now consider the balance eguations. First ccnsider 


State A. Since the HIO enters the system infrequently, a 


248 





single step transition into A may take place from any A 
j,M+1 


or - me as though the HIO did not exist. Thus, the 
+1,) 


balance equation associated with state A will contain terms 


x 
Similar to ali of those in (5.3). However, from state A 


the system can transition into state A by having the HI0O 


complete service and leave the system. Thus, one term nust 


be added and the balance equation becomes: 


M 
te 
>. 20) R(A)P (A) = (1/2) P (A ) + S(n Jip G Pu Ck 
2 e M+ 1 Sap elae 
i= 
iM 
To OG @({n )P (A ) 
. j M+1 7) € fei 
Bis 
* * 


NewecOnsciaer state A. A transition into state a 


by having a “tok complete service at PPj is validif ae ; Pa 
+ 


* 


ma must re frcem state A tee A transition into A by 
J, ut 


having a zob complete service at the CPU is valid only in 


the case that n > 0 for some j = 1, 2, «oe, A and the job 
J 


which completed service at the CPU was preventing the dI0 


mecm receiving service. That is, such a transition must be 


mecm a state A Such that No oe0. Note also that it the 
M+1,5 J 
Mec arrives when the system is in state A, and if nee = 0, 
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the HIO will immediately enter service and the system will 


«x 
enter state A . Hence, the balance equation associated with 


Pat 
je’ j,ue1 


ll IM ff 
Kh 


' x x 
f>.2/) R(A )P (A ) = @(n ) 
2 M+1 ; 


re 4 


$ 
too eps @(n )P (A 
cc Or Che CoP 
dae 


Cee (0 ) JwP (A) 
Vita 2 


5 
metal y, if 7 > Q, consider state A. A 
‘ios 


# 
transiticn intc state A by having a job complete service at 


Meg tS Valid if na > 1 and must be from state A acne 
eT Jurca 


# 
reason n Must be at least two is that A. is not a 
ae le 


State if a = 1. (Renember, the number of jobs at the CPU 
+ 


# # 
iS One less for A. iMagdn  fOLwA. jen thansiclon inte 
Jt 


# e 
State A by having a job complete service at the CPU is 
impossible since if the HIO is enqueued at the CPU pricr to 
Such an event, it would enter service. However, since i 
in? 


* 
> 0, the system enters state A if the HIO enters the system 
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when the system iS in state A. Thus, the balance equaticn 


# 
mssociated with state A is: 


¥ * a 
EN. 28 R(A )P {A ) = Zale E&P (2 P (A 
( ) ee, (2) are 3 2 | 5, u+t mae (2) 
= 


As in section 3, the distribution seen by the HIO is 
conditional upon the HIO receiving service at the CPU and, 
therefore, is determined by renormalizing the probabilities 


asscciated with the starred states. Hence, the final result 


xx 
cannot change if, instead of the P (A )'s, some multiple of 
2 


them is ccnsidered. For each state A of the system without 
mies HIO (1.¢€., the system considered in section 2), define: 


> 4 
(5.29) h (A) = P (A )/(ew) 
e e 


If the value cf h (A) can be determined for each such A, a 
€ 
renormalizaticn will yield the sought-after distributicn. 


Meewill also be convenient to define: 
+ 
f- 30) g {A) = P (A )/w 
e e 


mor G€ach state A = (nN gn ,eoe,N ) such that n aa Oe 
2 M+1 M+ 1 


Ncte that since P (A) is a probability, it is 
= 
Pounded as w and e both approach zero. Substituting (5.30) 


into (5.28) and dividing through by w yields: 
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M 


* 
(5.31) Mitmagetaye> Oth i) 26 g (A. ) + P (A) 
e a+ = ec, itt e 
j= 


Mme ach State A = (NM gn zeeeyN ) such that n PaO 
Ue M+ 1 M+1 
Using the principle or mathematical induction, g (A) is now 
= 


Sshcwn to Ee bounded for eacn such A as w and e both apfroach 


zero. First consider a state A such that n = 1. Then, 
A+ 7 


A # 
mest) Leduces to R(A )g {A) = P (A). Since R({A) is 
= 2 


constant with respect to w ande (see (5.25)) and P (A) is 
3 


bcunded, g (A) must be bounded as w and @2 beth approach 
cS 


9 


zero. Now suppose that k 1S any poSitive integer less than 
N and that ae) 1s Known to be bounded for every state 5 
With k or fewer jorks at the CPU. Let A be any state such 
that ae =k +1. Then for each j = 1, 2, oe, M, 


Be (A ) is bounded as w and e both approach zero since 
ee j,M+1 


there are k icbs at the CPU in each such state. Since 


* 
mao), g(n a, and rc are independent of w and e, anda 
M+ 7 


since P (A) is bounded, (5.31) says that g (A) is bounded as 
c 2 


Wand e Ecth approach zero. 


Nowesy substituting (5.29) and (5.30) into (5.27) 
m@dedividing through by w, 1t is seen that: 





M 


4 
(3-32) Se) ee) ee ee (0 eee he (A ) 
e Hee 2 3,4) 
oe 
M 
a Die n 4A 
2°, ore aie poss m+1, 5) 


+ (1 - g(n TE Ea) 
M+1 & 


P 
Since eR(A ) approaches one aS e approaches zero, an 


inductive arcument Similar to that used in the last 


paragraph shcws that h (A) is bounded as w and e approach 
é 
zero together. 


Spe tatacind (5.29) into (5.26) yields: 


M 
fe. 33) R(A)P (A) = wh (A) + (mn .) Sr P (a. ) 
2 =) M+1 7 © jJ,27! 
ee 
M 
+ Sober O(n )P (A ) 


ee Bice t een aciit ne) 
= 


Since h (A) is bounded as w and e approach zero, the first 
2 
term on tke right side of (5.33) vanishes as the limit is 


meee, aod in the limit (5.33) is identical to (5.3). That 


is, in the limit P (A) approaches the P(A) in (5.4). Since 
e 


fen) and g (A) are bounded, (5.29) and (5.30) indicate 
e e 
* # 
that P (A ) and P (A ) both approach zero with wande. So 
€ 2 


again it is seen that as the time between cbservaticns 





becomes lcngéer and the duration of the observations become 
shcerter, the probability of finding the HIO in the systen 
decreases toward zero, and the probability of finding the 
system in a given state wnich does not include the HIO tends 
toward the probability of finding the system in that state 
if the HIC dces not exist. 


Since the limit of P (A) as w and e approach zero is 
2 


now known tc exist (it 1S equal to P(A)), the same inductive 
arguments used above to show that g (A) and h (A) are 
= 2 
bounded show that, for each state A = (n eee ), h(A) 
1 M+1 


exists and, if a > 0, g(A) exists where: 
te 


(5.34) h (A) 


lin h (A) 
S 


e,w-->0 


i. 35) g (A) lin g (A) 
€ 


e,w-->0 


Furthermore, the values of these limits may be determined in 
terms of the P(A)'s and the system parameters by first 
recursively solving for the g(A)'s uSing the limiting form 
(>. 31): 


# 
i. 36) Rare ocay = O(n —1) > ci g{A. jet re (4) 
a+ 1 2 Sholay | 


Bd then sciving fcr the h(A)'s using the limiting form of 
ee 32) 


Zou 





De! h(A) = 35 b A 
( ) (A) Zz «ene eee teal 


ten 2 (Noe) |P (A) 
M+1 


The distriktuticn seen by the HIO may now be determined by 
normalizing the h(A)'s. Note that h(A) = 0 if all of the 
Meemare at the CPU in state A. The necessary calculations 


May now ce specified in the form of an algorithn: 


Algorithm for 
Calculating a8 poe wpenc ce Distribution 


Seen by e HIO 
ee Using (5.4) with K = 1, calculate P(A) for 
mae State A = (MN ,N ,er+,N ) such that n = 
2 M+1 M+1 


0. Let m= Q. (The value of m is the number of 


jobs at the CFU in the states, A, for which h (A) 
1s keine calculated.) 
(Qi) Using (5.4) with K = 1, calculate P(A) for 


Saem State A = (NM ,;N -geeoeel ) such that na = 
1 ee M+1 M+ 1 


mt 1. 
meeryusings (5.36), calculate g(A) for each state 
A = 0 a Pesuch Ee hat nh =m*+ i. Note 


M+1 A+ 


+ 
that the value of R(A ) should be calculated fren 


(5 25).. 
eepemusing (5.37), Calculate h(A) tor each state A 
Sein 1 2» .6< + 7D ) such that n = ih. 


z M+1 M+ 1 
(ominercase m by 1. If wm < N, go to (11). 
Otherwise, set n(A) = O where A = (0,0,...,0,N). 
(vi) Set - equal to the sum of the P(A)'s and a 
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egual tc the sum of the h(A)'s. For each state A, 
7S is the true steady-state probability of 
finding the system in state A, and Ze. is the 
steady-state probability that the HIO finds the 


system in state A. STOP. 
4.2. Generalizations 


In the case of the event-keyed observer of secticn 
3, the cause cf Dias was the fact that the cbserver always 
received service immediately after a job had routed frem the 
CPU to the PF's. In the case of the HIO, this is not always 
true, althouch it is true in every case where the number of 
jobs at the CFU is no smaller than the number of servers 
there when the HIO arrives. That is, if the number of 
servers at tke CPU does not exceed the number of jobs in the 
system (and if the CPU does not have a PS guéuing 
discipline), the HIO cannot observe any state in which all 
of the jcks in the system are at the CPU. In addition, bias 
Will be introduced if, in some cases, the HIO must wait 
before receiving service. This is true even in the limit as 
the time between visits gets large and the duration of a 
Service interval gets smail. The reason 1s that the amount 
of time the HIC must wait (and thus the numcter of 
@ransiticnos which could occur in that time) is independent 
of the time between visits and the service time. Note that 
if the CFU has an IS or a 9S gueuing discipline, then no 
bias exists (in the limit) since the HIO always receives 


immediate service. 
Generalization of the form of the network py 


allowing wtobs to mcve from one PP to another without first 


LTéceiving service at the CPU complicates the problen. 
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Rather than sclving for the g(A) ‘'s recursively as was done 
in the prededing subsection, it is necessary to solve a 


series of systems of linear equations. 


Finite capacity at the CPU raises questions 
concerning the possibility of the HIO not being allowed to 
enter the system. It must also Le assumed that the HIO is 
not subject to bulking restrictions and that the HIO cannot 


be preempted. 


Generalization of the number of job types, of the 
number of servers, of queuing discipline (except as 
restricted in the preceding paragraph) and of service 
distributions (to generalized Erlangian distributions) can 
all be handled in an analysis similar to that of the 
preceding suksecticn with appropriate changes to the balance 
equations. Details of these generalizations will not te 
discussed here since the analysis is, in most cases, tedious 
Without beinc instructive. In each case the balance 
equations must be generated and it must be assumed that the 
solution is known for tne case in which the HIO does net 
exist. The distrikution seen by the HIO is then found by 
sclving in scme recursive manner for the g(A)'s, using these 


to get the h(A)'s, and normalizing the h(A)'s. 
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In previous chapters ways in which the egquilibriun 
distribution can be determined for a wide variety of 
central-server models have been discussed. Many potential 
applicaticns of this technology can be modelled as a network 
of queues having a central-server model as a major 
subsystem. Sections 3 and 4 of this chapter present two 
examples cf this situation. In both sections the 
central~server submodel represents a computer and the 


remainder of the system is "external to core." 


In order to be able to apply the technigues of Charters 
II and IiI, certain assumptions must be made concerning the 
relationship between the subsystem and the remainder of the 
model. Thesé€ assumptions are embodied in the concepts of 
decomposition and aggregation as discussed by Courtois [27}. 
These concepts are introduced in section 1. Some details 
Ccncerning their application to models having central-server 


submodels are presented in section 2. 


1. DECOMEOSITION AND AGGREGATION 


Consider the class of models having the general form 
pictured in Figure 6.1, where box A represents the portion 
Sethe queuing network external to the central-server 


Suctmodel, Tre first subscript on each a, D0 andc,., 
ij 13 13 


refers to a job type and the second subscript to the 
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processor nugskter. The a | are the branching probabilities 
13 


of the central-server submodel. Thus, for each job tyre i, 


Meeeeach i and j, -. is the probability that a type-i job 
1. 


wili remain within the central~-server subsystem after 


completicn of service at processor j, and c_ is the 
135 
probability that it will leave the subsystem. Thus, b_ + 
15 


Mee | rcr €ach 1 and j. 
13 
So that use may be made of the steady-state probability 


distributicn for the central-server model, it is assumed 


that b o> c for each job type i and each gueuve numter 3 
23} ag) 


Ply 2, ~--+, M+t1. This assumption allows use of the ideas 


of decompesition and aggregation as discussed by Courtois 
{27 ]. According to Courtois, a system is decomposible f: 

1(1) interactions within groups can be studied as 

if interactions among groups did not exist, and 

(11) interactions among groups can be studied 

Withcut reference to within group interactions. 
In the context of Figure 6.1 this means that interactions 
between the central-server submodei and the remainder of the 
queuing néetwerk (box A) are so infreguent, as compared to 
those within the submodel, that the submodel is able tc 
"reach eguilibrium"™ between successive interactions with the 
remainder of the network. As a result the steady-state 
distributions may be determined for the central-server 


Sukmodel, Figure 6.2, and, then, used to determine the 








Figure 6.2--Central-Server Submodel 


from General Network 





properties of an aggregate queue, C, for use in studying the 
entire mcdel with the central-server submodel replaced by 
Bm@esaggregatée queue, Figure 6.3. A Similar technique is 
used by Chandy, Herzog and Woo [21] in their applicaticn of 


Norton's thecrem. in practical terms the assumption that 


b o> c.. fer all 1 and j is equivalent to an assumption 
ae) 13 
that jobs visit the CPU (queue M + 1) many times before 


departing frcem the subsysten. 


Actual isplementation of the method outlined above 
would, in general, invoive sufficient assumptions ccncerning 
the queues to allow use of a product-form solution, ala 
Baskett, et. al. [6], OF numerical technigues such as those 
Meecussed in Chapters II and III. In particular, so that 
the model in Figure 6.3 can be analyzed, a fcrm of service 
distribution must Ee assumed for the aggregate queue C. For 
Simplicity, service distributions at C are assumed to ke 
exponential with state-dependent rates. 

Secticn z examines more closely the assumed form of the 
aggregate gueue C and indicates how to determine the rates 
frcem the steady-state soiution of the central-server acdel, 
Figure 6.2. Secticns 3 and 4 contain examples of Situations 
in which this technigue could be applied in models of 
Multiprogranmmed computer systems. Section 3 examines a 
model in which the tape-mounting process is considered. 
Section 4 considers models of core allocation to jobs as 


they enter ccre from the input queue. 
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See AGGREGATION OF THt CENTRAL~SERVER MODEL 


Consider the problem of replacing the central-server 
submodel in Figure 6.1 by a single aggregate queue, C. In 
order to analyze the resulting model, as depicted in Figure 
6.3, the prorerties of this aggregate queue must be either 
kncwn or assumed. It is assumed that all service 
distributions at gueue C are exponential, though the service 
rates may ke state-dependent. In this section these rates 
are determined under the assumption that interactions 
between the aggregate gueue and the remainder of the network 
are infreguent enough that equilibrium is reached within 
gueue C ketween pairs of such interactions. A "conditioning 
= unconditicning"® approach similar to that often used in 


renewal theory is used here. 


Metice iLrcm Figure 6.1 that any job circulating amcng 
the queues of the central-server submodel could be the next 
job to emerge from the submodel and enter the remainder of 
the netwcrk (box A). Thus, the queuing discipline assumed 
Merequeue C aust reflect this preperty. In their 
meer2caticns cf Norton's theorem to networks of queues, 
Meandy, Herzcg, and Woo [21] make the aggregate queue an 
Mmitinite server queue and "dispense" the total service rate 
amcng ali cf the jcbs at the queue. A Similar approach is 
Maken here, except that the infinite server assumption is 
misleading since bcx A may may contain a queue for C. This 
is the case in the models discussed in sections 3 and 4 
where the central-server submodel represents a computer. 
The number of jobs “in the computer" is constrained by the 
amount of core and other resources available. Cis 
therefore pictured as a multiserver queue in which the 


humker of servers is state-dependent. 


Since the discussion involves both the model depicted in 


264 





Figure 6.3, kereafter called the overall model, and the 
central-server model depicted in Figure 6.2 concurrently, it 
is convenient to have notation which distinguishes between 
the two mcdels. Denote by W the state space of the model 
depicted in Figure 6.3. Consider any state S inwW. A 
specification of the number jobs of each type in service at 
queue C must be includéd as a part of any description cf 
state S. Because of the assumptions concerning the queuing 
discipline ard service distributions at C, ne further 
informaticn ccncerning the contents of gueue C is required 
Me~ea descrifrtion of state S, though additicnal infcrmation 
May be required to specify the waiting line for entry to Cc. 
AS seen in Chapter II, changing the composition of jobs ina 
central-server mod2]l (that is, changing the number of jobs 
of one or mcre job types) changes the state space. This is 
true even if the total number of jobs does not change. 
Denote the state space of the central-server model depicted 
in Figure 6.Zz by Q(S) when the overall model is in state S. 
memece the ccmposition of jobs at C is specified by a 
@escripticn cf S, the dependence of the state space of the 
central-server modéi upon this composition or jobs is 
expressed as a dependence upon the state S. Note that it is 
possible that Q(S)) = Se £Oz =o # a Om Deer imon 


Now let S$ te any element of W. The service rate at the 
aggregate queue C for jobs of each type is determined Ly 
conditioning upon the state (from Q({S)) of the 
central-server model represented by C, and then 
unconditicnirg by.using the steady-state probabilities for 
the central-server model. Note that the result is still 
conditional upon the overall system being in state S. That 


mean the service rates at C are state-dependent. 


Let the composition of jobs in the central-server trodéel, 


Figure 6.2, te that specified in a descripticn of state S as 
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the compoSition of jobs in aggregate queue C. Then the 
state space for the central-server model is Q(S). Also 
assume that the steady-state distribution has been 
determined, maybe ty using the technigues discussed in 
Chapter II cr by using a product form solution. For each A 
ma O(S), let Bet) denote the steady~state probability that 


the central-server system is found in state A. 


Let A be any state in Q(S). From a description of A and 
a specification of the parameters, service distributions, 
gueuing disciplines, and so forth for the central-server 


model, the rate, rr, at which the system leaves state A by 
13 


having a typfe-i jok complete service at queue j for each job 


type 1 and each queve j = 1, 2, ..., M+ 1 (given that the 
System is in state A) can be determined. The following 


example illustrates how r would be calculated in a variety 
1) 


of situaticns. 


Example 6.1 


Suppose PP1 contains two type-one jobs and three type- 
two jobs in state A. Furthermore, in the cases in which it 
is a factor, the type-two jobs are known to have all arrived 
prior to the type-cne jobs. (LE Jee erS ae hacron,,.this 
informaticn would te contained in the state description for 
State A.) Suppose that all service distributions at PFi1 are 


exponential with service rate v._ for type-i jobs. 
al 


(a) If FE1 has a FCFS discipline and m servers, 


then r = Q ande =a eS pre = 
1 2al 2 11 


Wate 2 .M—-3) and Syl Gul psa ae 
71 21 2 
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(b) If FE1 has a preemptive LCFS discifline and am 
servers, then rc = mv ander =a ot oe S22 at 
11 1 21 

Ie = zv andere Sseveniln(s,0—2)) 1 m > 2. 

11 1 ol 

(c) If FP1 has a preemptive priority discipline 
and m Servers, the results of (a) apply if 
type-twe jobs have priority over type-cne jobs, 
but the results of (b) apply if type-one jobs have 
priority over typve-two jobs. 

(d) If FP1 has a PS discipline, then ae = aN? 


and r = 3v /5. 
aa Z 


(e) If the CPU has finite capacity and can accept 


no further jobs until a job leaves, tnhen r and 
11 


SS are aS specified in (a) - (d) with m replaced 


by m-k where k is the number of blocked servers at 


eaeue 47. In particular, 1£ k = mn, Cc =Qe-=r ., 
11 21 
Now suppose that the service distributions at PP1 are 


generalized EFriangian and let v. be the service rate in the 
1k 


k-th stage and cee the probability of departing the queue 
ae 
after completing service at the k-th stage for type-1i jobs. 


(ft) If £F1 has a single server and a FCFS queuing 


discipline, then rc = 0 ander =gq Vv Lf the 
11 21 2k 2k 


(type-twc) job in service is the k-th stage of 


Service. 


Now returning to Figure 6.1, notice that, if the 
central-server subsystem transitions from state A by having 
a type-i jceb leave gueue j, then the probability that that 


jeb will leave the subsystem (at that time) 1s c_.. Thus, 
1) 
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r c..is the rate at wnich type-i jobs complete service at 
13 1) 
queue j and depart the central-server subsystem given that 


the subsystem was in state A. From this it is seen that, 


FOL each job type i, the rate, R (A), at which type-i jobs 
1 
depart the subsystem given that the subsystem is in state A 


is given Ey: 


(6.1) eG) 2 arene 
al 


Meme that although the values of the r. are also 
13 


conditional upon the central-server subsystem being in state 
A, this ccndition has been suppressed in our notation. 
Using the steady-state probability distribution for the 


Central-server model with state space Q(S), tne condition on 


state A may now Fe removed to determine the rate, T (S), at 
a 
which the overall system transitions from state S by having 


a type-i job leave the aggregate queue C given that the 


System is in state S: 


b] 


(6. 2) {S) = 3 &, (A)P_{A) 
28 ne 5 


AEG (S) 


At this fcint more precision is possibile in specifying the 
Character of the aggregate queue C. Cis a multiserver 
Gueue with exponential service distributions. Both the 
humber of servers and the service rates are state-dependent. 


If the overall system is in state S (an element of W), and 
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if n is the number of type-i jobs at C in state S, then the 
al 


Muemeeec Cate for each type-i job at C is T (S)/n if n >O 
a a # 


Siders immaterial if n = 0). Furthermore, if n is the 
7 


total number of jobs at C in state A, then n is also the 


Nnumker of servers at C, given the system is in state S. 


iieenuth, the exact character of C is usually 
ubimportant since the goal is 2xamination of the systen 
represented in Figure 6.1 by studying the balance eguations 
(or the Kegclgorov dirferential equations) for the overall 
System as represented in Figure 6.3. For these equaticns, 


only the I (S) are required. 
1 


Computaticnally it is generally unnecessary to solve the 
appropriate central-server model each time a new state from 
W is considered. Typically many states from W will have the 
same composition of jobs at C. Hence, the procedure tc 
MereOwW iS; First, for each feasible composition of jobs at 
C, solve the corresponding central-server model for the 
steady-state probability distribution. Use this 
MretLipution in (6.2) to calculate T (S) for each job type 


* 
meeand store the fT (S). Then, in developing the balance 

Bh 
eguations for the overali model, use (for each S in W) the 


Mis) COLrrespoOnding to the composition of joks at C 
i 


apEropriate for the state S under consideration. Storage of 


mmeer (S) for efficient recall is aided by the fact that the 
a 

Bempositicn cf jobs at C can be represented as a vector 

Beye ) of nonnegative integers, where, for each i = 


Mea, ---, kK, n is the number of type-i jobs at C in the 
aE 





compositicn under consideration, and the number of job types 


is k. The frecedures of section 3 of Chapter II can be used 
to sequence the vectors representing feasible compositions. 


Meet (5S) may be stored in an array T such that T(i,j) is 
1 
memeseecOr the j-th composition. For each state S, it would 
ai 


then be necessary cnliy to determine the sequence number j 
corresponding to the cemposition of jobs at C specified in 
the vectcr description of S. Procedures for doing this are 


also specified in section 3 of Chapter II. 


3. THE TAPE~MOUNT PROBLEM 


In mcst modern computer centers users are able to retain 
and use privately cwned storage space, data sets and progran 
licraries on magnetic tapes and disk packs. Each job 
requiring use of such a device must wait for the appropriate 
number of tape drives and disk drives to pe allocated and 
ror the tapes and disks to be mounted before core can fe 
allocated for it. The physical operation of mounting the 
tapes and disk packs is performed by computer operators. 
Because of the high speed with which computers are able to 
handle mcst jobs, and because the computer operators have 
Many other duties, the time required to mount a tape or dis 
after the drive has been allocated is often many times the 
time required for the computer to service a Single job. As 
a result the computer could become severely underutilized 
if, during scme period of time, most jobs reguire such 
mounts. This is the tape-mount problem. In this section 
Only tapes are considered explicitly. Private disk packs 
could be handled the same way or could be lumped together 


With tapes as a Single type of resource. 
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In an effort to examine the tape mount froblen 
consideraticn is given to the model depicted in Figure 6.4. 
(Figure 6.4 should be compared with Figure 6.3.) Twe types 
of jobs transit through the system. Type-one jobs require 
ne mounts, but type-two jobs do. The box marked TM 


represents the tape mounting procedure; Q is the line of 
1 
jobs waiting for drives to be allocated or tapes to be 


mounted. C represents the computer itself and is an 
aggregate gueue representing a central-server submodel (see 


Miagure 6.1). a is the "core-allocation queue" where jobs 
await servicing by the CPU. All mounts have been perfcrmed 


OL type-twe jobs in oe 


The jobs at C have been allocated core and are currently 
being serviced by the computer. The maximum number cf jcbs 
at C may ke restricted to be the maximum attainable level of 
muiltiprogramifing for the computer under consideration (or 
scme average level of multiprogramming), or the ideas 
discussed in the next section may be utilized here to aiso 
model the core~allocation procedure. For the present 
discussion assume that there is some maximum number, N, of 
jobs which can simultaneously be at C, and that no 
Semoinaticn cf N jobs is restricted because of core 
@llocaticn. (Note that there may be a restriction if the 
facility does not have a sufficient number of tape drives to 
allow N type-two jobs in the system simultaneously, but this 
Meetricticn is not because of core allocation.) Aliso assume 
that each type-two jcb requires exactly one tape, and that a 
finite number L of tape mounts are available to the systen. 


Thus, the total number of type-two jobs at IM, 2, soa, (6 


Cannot exceed L, though more type two jobs might be at Q.- 
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Figure 6.4--Network for the Tape-Mount Problem 
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AS a consequence, it 1s possible to nave TM empty even if Q 


m= not. 


Berore ccnsidering the box marked D in Figure 6.4, 
consider the central-server model from which (ala section 2) 
C will receive its properties. This model is depicted in 
Figure 6.z. Since each type-two job has its own tape, and 
Since all tapes must be mounted before a job can enter C, 
there is no queuing for tape usage and no degradation cf 
service tc jcbs using tapes if another job begins to use a 
tape. Thus, all tape drives together may be considered as a 
single, infirite server queue. Letting PP1 be this quéue, 
Ss = 0 since no type-one jobs use tapes. (Note that the 
tapes model discussed in Chapter IV meets the description 


given here.) 


Now ccnsider the box marked D in Figure 6.4. This box 
will be mcdelled in different ways for different models. 


For example, if it is assumed that there are exactly 7 
typée-one jobs and 7 type-two jobs in the model of interest 
at every instant of time, box D need not exist. If the a 
and - Ma tye at ae + oe remains constant, box D may 
represent a "place" where in zero time a job does or dces 


not change type according to a probability distribution. On 
the other hand, box D could represent source and Sink with 
jorks enterine D disappearing (leaving the system) and 
periodically new jobs being created (read in) and routing to 


2, Or 2. accerding to job type. If the iatter is the case, 
a maximum nuaker of jobs in the network should be fixed to 


keep the state space finite. 
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mgmotLing the erfect of D on the state description (if 
any), and assuming exponential service at TM, a state of the 


meeecm Nay be represented as (t ,t ,t ,X ,X ,++-X ) where 
ae is 1) ew, k 


- = the number of type-one jops at Cc 
2 = the number of type-two jobs at C 
i = the number of (type-two) jobs at Q, e\yacl IMs 


combined 


X ,X geeoe,X = the order of job types at Q 
i k 2 


The restricticns to be used in determining which nonnegative 
integer vectcrs represent valid states include: 
Rule 1: ee <S oN 


moe 25 t +t SN. 


1 2 
mee 3; t s L. 
2 
Rule 4; uF + s + S S$ maXimum number cf jobs in 


system. 
meee ose K = QO if t + t < N. 
1 2 
mote 6: +t + L. + - + k S$ maximum number of jobs 
1 
in system. If the total number of jobs is fixed, 
this Sum must equal the total number. 
Rule 7: The number of twos in a ee < 


ea te 
2 


For é€ach such state, the number cf jobs in service at TM is 


the maximum possible given that it must be no larger than 
t , no larger than the number of servers at TM, and no 


larger than the number of available tape drives. The number 


of available tape drives is L minus the sun cf S and the 
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Meme: Of twoS 1M (X ,X goueyX ) 
le 2 k 


Notice tkat the effect of changing the number of tape 
drives may be studied by varying L. The effect of changing 
the number of operators might be studied by changing tke 
number or servers at TM. The effect of dedicating cperators 
to the tape acunting oferation might be studied by 
increasing the service rate at TM. The service distriktution 
at TM could also be modified to a generalized Erlangian 
distributicn by adding another component to the state vector 
for each server (see subsection 2.5 of Chapter II). The 
case of "bulk mounting" can also be modelled if an 
additional ccmponent is added to the state vector. In bulk 


mounting the cperators wait until 2, Contains at least +t 
tapes for which tare drives have been allocated. They then 
meunt tapes until either all drives are busy or 2. 1S EnNcty. 


The compcnent added to the state vector should be one when 
the mounting operation is underway and zero otherwise. It 


changes trem zero to one when the numper of jobs at a and 
the number of available tape drives both reach t and fron 


one to zero when one cf these two numbers drops to zerc. 


The numker of tapes reguired by each type-two jor could 
alec be generalized. This could be accomplished by using 
type-two jobs, type-three jobs, ..., where type-k jcbs 


reguire that k-1 tapes be mounted. 


Now consider another nodel in which the decomposition 
ané aggregaticn concepts are useful. Once again the 
aggregate gueue will be a computer which can be represented 
as a central-server system. This time the problem is cne of 


mere alilccaticn. 
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G4. THE CCRE-ALLOCATION PROBLEM 


men OL tle Constraining factors in the level of 
multiprogramming of a modern computer is the amount of 
primary, cr core, storage available. How available core is 
allocated to the jobs awaiting service is an important 
decision for the managers of a computer facility. For 
example, suppese a job requiring 100K is at the front cf the 
queue and a large number of 25K jobs follow it. If 25K 
becomes available, shouid that 25K remain idle until 100K 
has accumulated and the first jop in the queue can be 
served? Or should the smaller jobs be allowed to bypass the 
10CK job and utilize the available core? From the 
Standpoint of efficient urilization of the available 
resources, the latter is the course to adopt. However, in 
an extremely busy computer center such a policy could lead 
to serious turnaround problems for larger jobs (and 
potential lcss of goodwill with customers who are providing 
a large porticn of the center's income). In addition, 
searching lcng input queue lists for a job small enough to 


fit into available core can be a costly overhead iten. 


An alternative to both the strict FCFS scheme and the 
byrass scheme is ore in which the queve is divided intc two 
Marts. Tke first k jobs {1i.e., those which have been 
Waiting the lengest) form what will be called the anteroon 
queue. All cther iobs form the "hallway" queue. Althcugh 
bypassing is frermitted, only the jobs in the anteroom queue 
Can be allccated core. Thus, it is necessary to search only 
the anterccm queue of k jobs each time core is made 
@vdilable. A job from the hallway queue is allowed to enter 
the antercom gueue each time core is allocated to one of the 
k jobs in the anteroom gueue. Now the question of interest 


is: What value of « (what size of anteroom) will provide 
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reasonable service for large jobs without serious loss of 
efficiency? Models similar to those presented in this 
section cculd be used as a tool by managers in determining 


an answer to this question. 


Consider the model depicted in Figure 6.5. As in 
section 3, C is the computer and the model depicted in 
Figure 6.2 1s analyzed (ala section 2) to determine its 
properties. Q represents the anteroom gueue and will 
contain at mcst k jobs. Conceptually box D contains the 
hallway gueue and, perhaps, a source and sink for jcbs ora 
moeetype changing facility. In the models discussed here, 
miencontents cf D will be represented by a single number, if 
at all. 


Suppose that the computer has a total of M units of core 
availiable fcr users! jobs. (The unit of stcrage could be a 
Myce, IK cytes, 100K bytes, a page, or some other 
appropriate unit. M is considered to be an integer, as is 
the number of units required py a single job.) The jocs may 
be classifiec¢ acccrding to the number of units of core 
required. Fcr example, suppose that type-i jobs require 1 
Mmmmcmot core for i= i, 2, ..-, M. In practice there may 
be many values of i for which no jobs ever exist, and scme 


other numbering scheme may be more practical. The type oz 
each job is determined from a probability distribution, 


M 
{q.} 


fH i=1 

Note that it is possible for there to be core available 
even though the anterocm gueue is full (1.e., contains kK 
jobs). For example, the anteroom queue could be filled with 


Marge jobs wken a small job leaves C. 


Each time a job leaves C, the anteroom queue is searched 


cae 








Figure 6.5--Network for the Core-Allocation Problem 
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meeethe first job which wili fit into the available core. 

If one is fcund, it enters C and a job from the hallway 
guéue joins the anterocm queue at the back. If core is 
still available, the anteroom queue 1S searched again. This 
precedure ccntinues until either no core is available or no 
jeb in the anteroom queue will fit into available core. 

Frem this description it is important to notice three 
things. First, the number of jobs at C is variable. 

Second, two cr more joks can enter C simultaneously, but 
joks enter C cnly when a job leaves C. And third, a job can 
Simultaneously enter the anteroom queue from the hallway 


queue and enter C withcut delay in the anteroom queue. 


One way cf representing the states or this 


core-allccaticn model is with a vector of length M + k + 1: 


"Te pre «7 Nl 8 5A a ca ro).er gas eee eect eor ee th aS 


meres number of type-i jobs at C; for j 


il 

ond 
= 
DO 
& 
e 
e 
é 
~ 
ay 
™ 
ct 
hb 
W) 


miestype ci job in the j-th position in the anteroom queue; 


h is the number cf jobs in the hallway queue. Note that the 

type of a jok in the hallway queue does not matter until 

that job enters the anteroom queue. Thus, as jobs enter the 
M 


Siteroom gueuc, the prebadility distribution {gq}. 
1 i= 


is 


@eetied. 


If the model is closed, jobs leaving C immediately join 
the hallway queue. In this case h need not be retained as a 
Mirt of the state description since it can always be 
computed from the total number of jobs in the system (N), 
the number cf jobs in the anteroom queue (usually k), and 


the number of jobs at C (the sum of the n ‘'s). If N is so 
1 


large that there are always k jobs in the anteroom queue, N 


BATES: 





need not be specified since its importance is primarily to 
indicate wkether or not jobs are available in the hallway 
queue when a vacancy occurs in the anteroom gueue. [If N is 
relatively small and there are mw < k jobs in the anteroon 


gueue, then t = t fees cece = © by convention. 
m+ 1 n+2 kK 


If the mcdel is open, jots leaving C disappear from the 
system and new jobs are created (probably according to some 
interarrival time distribution) at D and enter the hallway 
queue, the anteroom gueue or the computer depending upen the 
state of the system. In this case it is important to retain 
h. The potential exists in the open model for the entire 
system tc empty cf jobs. The potential also exists for the 
number of joks to become infinite. Thus, in order to retain 
a finite model, it is necessary to restrict the size of the 


hallway queue. 


The chcice of core-allocation scheme becomes nost 
critical when the system is very busy. When there are few 
jeks in the system, turnaround time for user jobs is usually 
not a prcblem and core utilization does not approach 100% no 
Matter what scheme is used. Hence, even though it may be 
mcre realistic tc consider an open modei than a closed nodel 
(after all, real systems do occasionally go idle), a closed 
model (with N large and unspecified and h omitted from the 
State vector) is probably a good choice for investigating 
the gquesticn posed above. Hereafter, assume a closed systen 
with N large enough (though unspecified) to insure that 


there are always k jobs in the anteroom queue. 


iemomerat (iene ,.e.,n , t,t ys..,t 9) must satisfy the 
ion we) k 


fcllowing ccnstraints to represent a valid state of the 


system descriked aLove: 





ecets 0) 2 0 for 1 = 1, 2, «.+, M. 


Rule 2: m=4- lint ees 145) 


fee 35> om < tt. 
J 
The number m calculated in Rule 2 is the core available for 


lA 


MESO my eS files 2 haces: KK, 


Memer user jors. The sum in that equation is the total core 


in use. 


Let L = (M+s)/2 where s = 1i1if M is odd and s = 2 if Mm 
is even. Then since the total number of units of core 


available for user jobs is 4M, 


= 


Hence tne state vector can be shortened by replacing the 


ccaponents n, n of ey aaslngile comoonen. a where 


i 
L+1 M 
i mercer 1 = Ly, L+l, ..., *® if there is a type-i job atc 


and E = 0 if ne jcb requiring &L or more units of core is at 


Meit kK > M, the state vector can be further reduced by 


Muemercing the components t , t , ««-, t by Sy, S gg wasy Sy 
1 2 k 1 2 4 


Muemerer Or cach 1 = i, 2, ..., M, S 1s the position cf the 
i 

first type-i job in the anteroom queue. If there is ne 

type-i jcb in the anteroom gueve, Ss = k + 1. With such a 
i 


description, the tyre of a particular job would not become 


kKncowo until it became the first job of its typé in the 
anteroom gqueve. To determine the type of a particular job, 


Meeis necessary to use a conditional distribution derived 


Zo) 





E 
meom {gq } ##. For example, if s =1, s =2, s = 4 and s 
1 1=1 M 1 3 a 


> 4 for 1 # 1,3,M, the third job in the anteroom queue is of 


type one with probability q,/(q td) and OketyoeeMy sith 
it 

probability 97a ta) Note that it cannot be of type 

three, for example, since the first type three job is in 


position four. 


Example 6.2 


Suppose that only two types of jobs, large and small, 
utilize the system, and that the large jobs require twc 
units of core and the small jobs only one. Assume that the 
System is busy enough that there are always k jobs in the 
anteroom gueuve. A state of the system can be specified by a 


vector VB oS where n is the number of type-1 ‘fobs 
af 


Mietne computer and s is the position of the first type-i 
ak 


jck in the antéroom queue. Since only two types of jocks are 


under consideration, further simplification is possible. 


Mmeesc, if - is specified, a is the largest integer less 
mian Or equal to ae If this were not the case, there 


would be two or more units of core availiable and a jok would 


enter the ccmputer from the anteroom queue. Second, = and 


Seace nct bcth required. For if = = 3, 5 = 1 and the job 


Mmethe seccnd fositicn is of type two. On the other hand, 


mms = 1, the first type-two job is in position two with 
1 


Pecbability oe position 3 witn propapdility Lee seeeee 


MeeitioOn kK With prcbability a Loe and not in the antercon 
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queue with preokability a - Thus, a state is completely 
specified by the ordered pair Wag) < Note that at mcst 


one unit cf ccre can be idle, and that this can happen only 


when there are no type-one jobs in the antercom queue. 
A program which generates the states and the balance 
eguations for this model has been written in FORTRAN. The 


input parameters are die Ve, ono esOk de — 07) 2. .., Y the 


Megpability, EETA(1,j), that a type one job is next to leave 
C given that oy = j. The states are sequenced according to 

a lexicographic crdering of the state vectors when arranged 

as a): With this sequencing procedure the coefficient 

@eeete 1S nearly triangular. Thus, a direct elininatica 


method is used to solve the balance equations. A weakness 
of the prcgram is that it effectively assumes that the mean 
time between departures from C is one time unit, independent 
of the state cf the system. This difficulty could be 
overcome Ly letting BETA(i,j) be the rate at which type i 
joks leave C given that - = j, and making BETA{2,j) input 


parameters too. The fclilowing table lists the steady-state 


BEodability of having an idle unit of core as a function of 
the size k cf the anteroom. The values of the other 


parameters are - =ee25, 1 = 6 and BETA(?, j) = aD eae 


1 
(Note that a newly arriving job is three times as likely to 
be a large gor as a small one.) 


K 1 2 3 ~ 2) 6 ri 8 2 
Pmcireeeso 29 «6624 0Clw 210 49) lw TF COTS TKS 


Ze6 





Note that since no more than one of the six core units 
available can be idle at one time, utilizaticn of core is 
better than what appears to be indicated in this table. For 
Beep ie, with k = 3 utilization of core is at [1.0 - 
(.z4/6) ] = 0.$6. Increasing k to 7 increases utilization 
my to 0.975. 


In the first section of this chapter the concepts cf 
decomposition and aggregation were introduced, and 
conditicns under which these concepts might be used to aid 
in analyZing a model which has a centrai-server submodel 
were discussed. The second section discussed more 
specifically how te determine the properties of a queue 
Which is an aggregation of the central-Server submodel. 
Finally, the last two sections were devoted to examples of 


Situations in which these techniques might be applied. 
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VII. SUMMARY AND REQUIREMENTS FO 


This final charter consists of a brief review of the 
first six chapters with special emphasis upen areas in which 
further research and development are needed. The 


-Organizaticn is Ly chapter. 


Mee CHAPTER I 


Mm@apter It, after an intrceduction to the motivation 
behind the werk that this thesis represents and a preview of 
the contents of the thesis, was used to establish the 
terminology and notation used throughout and to present a 
rather extensive review of queuing-network literature, 
particularly as applied to computer applications. [In the 
literature review several areas were pointed out where 


further research is required. 


One such area concerns the equilibrium output process of 
a single gueve. To be specific: MWhat is the output 
process cf a queue having given characteristics (number of 
servers, gueuing discipiine, capacity and service 
Mestcibitions) given a particular input process?" fhis 
question is frobably too general to answer except on a 
case-by-case basis. In view of the variety cf types of 
queues which lead to satisfaction of the local-balance 
conditions when incorporated into a network of queues (see 
Mme discuesicn of the work of Baskett, Chandy, Muntz and 
maeac@os [6] in subsectiony5.3 of Chapter I), it woulda be 


Ratural to start with cases in which the interarrival and 
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service times are generalized Erlangian, the queuing 
Meecipline is FS, IS or LCFSPR, and the capacity is 
infinite. The author suspects that the "interdeparture" 
times will te found to be generalized Erlangian also, 
perhaps differing with job type, and that independent 
departure streams will result from independent arrival 
streams. However, this is purely conjecture since no work 
has yet: keen attemrted in this area. If positive results 
concerning the departure process can be attained for queues 
of this type and also for queues which lead to violaticn of 
the local-balance conditions when incorporated into a 
network, a ccmparison may shed new light on fundamental 
differences retween gueve types which effect local balance; 
or a Simplified solution form, such as a preduct form, may 
be detected for networks of gueues which do not satisfy 


local-balance conditions. 


This last point leads to another area where more , 
research is required. To date (to the author's knowledge) 
there is no set of necessary and sufficient conditions for 
Beistence of a preduct-form solution. Reversibility is 
sufficient but not necessary. Except possibly for the 
quasi-reversikle models of Kelly [64], a preduct-form 
sclution has been exhibited only for networks satisfying the 
@enditicne of local balance. However, local balance has aot 
been shown tc te either sufficient or necessary, though it 
may be bcth. On the other hand, it is quite possible that 
mmece are networks which do not satisfy the local-balance 
conditions and, yet, which have a product-form solution. A 
Characterization is needed fcr networks which admit such a 


Solution. 


Investigation into the relationship between 
quasi-reversitility and the local-balance conditions may 
Shed some light in this area. This relationship 1s not 


currently knewn. Since the definition of 





guasi-reversibility given in {64} is in terms of 
independence of departure processes, it is not clear whether 
this concept can be extended to apply to closed networks. 


This is also an area which bears more research. 


Althcugh froduct-form solutions of the type discussed in 
Chapter I have received much attention, the possible 
existence of cther solution forms should not be ignored. 
This possibility has yet to bear fruit. However, the reason 


may be that it has not been explored. 


meee CHAPTER II 


In Chapter II the problems associated with determining 
the steady-state properties of a variety of Markovian 
gueuing netwcerks were attacked. The topics covered include 
representaticn, generation and storage of the states of the 
System and generation and storage of the balance equations. 
The netwcerks considered include multiple job types and 
gueues having a variety of possible queuing disciplines (as 
defined in subsection 4.2 of Chapter I), multiple servers, 
generalized Erlangian service distributions and finite 


Capacity. 


The representation of states of such systems as integer 
vectors frovices enough information within the vector 
representaticn to differentiate states from cne another. {It 
also leads tc a convenient method of generating the balance 
mauations,. The concept of constrained lexiccgraphic 
Sequencing of integer vectors then provides the key to 
Generaticn of the states and efficient storage of tae 


balance equations. 


Further werk cculd be done in topics covered in Chapter 
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II as other generalizations arise. For example, the ccncept 
Of bulking was introduced in subsection 2.7 (of Chapter ITI) 
and dealt with briefly in subsections 3.9 and 4.7. More 
detailed work will be required before bulking is actually 
inccrporated into a model. However, there is no need to 


invest this effort until an application is found. 


Another example is job-type switching. This could be 
inccrporated into the branching probabilities if switching 
is allowed while a job is in transit between queues. For 


example, P. ee could be the probability that a type-1 job 
¢ 9 a 


ccmpleting service at queue j enters queue mas a type-k 
job. This kind cf job-type switching is considered by 
Baskett, Chandy, Muntz and Palacios in [6]. 


As a final example, such non-Marxovian generalizations 
Bewecorrclated branching could be handled by appropriate 
chcice cf vector representation. For example, if the choice 
Memeeranching distribution from the CPU to the PP's in the 
central-server model depends upon which PP the last jor to 
leave the CPU routed to, the addition of a component tc 
Carry this infcrmation leads to the possibility of applying 


the techniques discussed in Chapter II. 


The models discussed throughout the thesis assume 2ero0 
transit time between queues. Poisner and Bernholtz [ 87,88} 
have examined models which would satisfy the local-balance 
Sonditions except that transit times have arbitrary 
distributions. The possibility of extending their results 
to more general models, such as those discussed in Charter 
II, remains an open question and, possibly, a fertile area 


mor Lurther research. 
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SeeeecCHAPTER III 


é 


Chapter III discussed a variety of numerical methods 
which could ke used to solve the balance equations resulting 
frcm application of the methodology presented in Chapter II. 
The Gauss-Seidel method, discussed in subsection 4.3 (of 
Ghapter Itt), is the method chosen by the author. Reasons 


for this choice have peen given in Chapter III. 


Many cf the models encountered when the network has a 
central-server structure are cyclic in nature. In fact, the 
three mcdéls which the author has programmed have pericd two 
See. , they are "2-cyclic” in the terminology of Chapter 
III). Chapter III contains a proof that the Gauss-Seidel 
method ccnverges to tae steady-state probanility 
distribution in these 2-cyclic cases so long as the states 
are arranced in a rather natural order (the third canonical 
form). It is conjectured further that the Gauss-Seidel 
method will ccnverge to this distribution neo matter what the 


order of the states (see the conjecture in subsection 4.3). 


This ccnjecture introduces an area wnich could use 
further research. Also included in this area is the 
guestion cf when ccnvergence of the Gauss-Seidel method can 
be proved for k-cyclic queuing models. It was shown in 
Chapter III that convergence can be proved if the rate 
Meer rx has first canonical form, and that lack of 
convergence can be expected if the rate matrix has seccnd 
Cancnical fcrm (unless k = 2). However, if a canonical 
ert, similar to the third canonical form for 2-cyclic 
models, is found to arise naturally for the general k-cyclic 
model, ccnvergence of the Gauss-Seidel method ror this 


maponical form is still an ofen questicn. 


Another area which is open for further research is 


8) ) 





acceleration of the convergence of the Gauss-Seidel method. 
Two possible methods for doing this are suggested in 
surksecticn 4.4 (of Chapter III): a relaxation procedure 
and an "informed" choice of starting vector. Neither rethod 


has been adequately explored. 


Other pcssible solution methods might also bear further 
Cxabinaticn. For example, specialized codes for solution of 
linear prcgramming problems have been considered. If cne of 
the balance equaticns 1s chosen to be the objective function 
and the nermality condition and the other balance equations 
make up tke ccnstraints, the steady-state probability 
distribution will be the only solution to the minimization 
preblem. Unfortunately, the fact that this 1s a square 
problem (the number of constraints equals the number of 
variables) makes a linear programming approach a poor choice 
given current technology. The reason is that the simplex 
method would require inversion of the whole matrix, rather 
than some relatively small submatrices as 1s usualiy the 
case with linear programs. The advantages cf the iterative 
technigues described in Chapter III over the direct 
technique used in the simplex method have already been 
mentioned. Many cf the problems of interest are not known 


to have any Kind of special structure. 


i 


4. CHAPTER IV 


Chapter IV reperted the results of three models which 
have been pregrammed using the metnodology discussed in 
@m@apters If and III. Two job types are assumed by each 
model, the types being differentiated by their service rates 
and branching frobabilities. Among the queues represented 
in the three mcdels are found an IS queue, a PS queue and 


both single- and multiple-server FCFS queues. 
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An example in section 2 (of Chapter IV) showed the type 
of errors which could result from making simplifying 
assumpticns. Unfortunately, many reascnable models could 
result in unmanageably large state spaces if such 
assumpticns are not made. In subsection 2.2 ways of 
approximating a network which violates the local-balance 
conditions with one which satisfies them were considered. 
The results for tne approximations considered were 


discouraging. Mcre research is reguired in this area. 


Related to this 1s work currently underway by Lehoczky 
and Gaver. By switching to a modified PS gueuing discipline 
and adjusting the service rates, they have developed a 
technigue for reducing the size of the state space. In this 
Way problems which would otherwise be too big can be reduced 
to a manageable size. Comparisons between runs of the FCFS 
prcgram and runs using their approximation method reveal 
excellent agreement in idleness probabilities and average 
occupancies at the various queues. Publication of the 


method and the results is forthcoming. 


Another aréa where further research is required is the 
inaccuracies resulting from application of Norton's theoren, 
as discussed Ey Chandy, Herzog and Woo [21], to models which 
Memnot satisfy the local-~balance conditions. For example, a 
Morton's thecrem analysis could be applied to a FCPS mcdel 
@nd tne results ccmpared to a run of the same case using the 


mers progran. 


Se CHAPTER V 


The rpessibility of bias in data gathered by software 
mcnitors was discussed in Chapter V. The author knows of no 


other work in which this problem has been mentioned, much 
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less examined. In that chapter a procedure was discussed 
for using a queuing model to eStimate the results which 
weuld be received from use of two different types of 
software monitcrs. Auxiliary results from application of 
this procedure coula then be used to measure the extent cf 
the bias. This could be used to help explain differences 
between measures of performance as determined using a 
software monitor and those determined using an analytic 


queuing mcdel. 


This procedure has not yet been applied to any numerical 
example. This iS an area open for further work. Also, 
cther models cf software monitors have yet to be examined in 


this context. 


However, a potentially mcre important area of research 
is the dual cf the guestion considered in Chapter V: "HOW 
are true system parameters and measures of performance to be 
determined frem software monitor data which 1s known tc be 
biased?" This question has not been addressed. On the 
other nand, a related question can be attacked using tke 
procedure given in Chapter V (assuming the queuing model 
used is an accurate representation of the system modelled). 
mt is: “What is the erfect of using, in a queuing model, 
System parameters estimated from data gathered by a biased 


software monitor?" Much research remains to be done. 


a CHAPTER VI 


Mmimenacter Vi some potential uses of the central-server 
model as a submodel were discussed. In general, the method 
Miecussed invclves replacing the central-server submodel 
with a single aggregate queue having state-dependent 


exponential servers. Determination of the rates of service 
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at this aggregate gueue are based upon the steady-state 
solution of the central-server submodel for each of the 


feasible job mixes. 


As twce examples of cases in which this technique might 
be useful, the tape-mount problem and the core-allocation 
prceblem were discussed. The former problem involves 
consideration of the time spent by operators in mounting the 
tapes required by user jobs. The latter problem involves 
consideration, and possible comparison, of different methods 
for deciding which of the various jobs waiting in the input 
guéeue of a ccmputer will be allowed entry when core becomes 
available. The two job types considered require different 
amcunts cf£ ccre. Thus, tne problem becomes: "When a small 
amcunt of core beccmes availabls, should a jcb requiring 
that amount cf core be aliowed to bypass earlier-arriving 


jobs which require more core than is currently available?" 


The application of the concepts of decomposition and 
aggregaticn tc models in which a central-server model, 
crepresenting a computer, is a submodel has only been 
Outlined in Chapter VI. The author kncws of no earnest work 
in this area. The core-allocation problem discussed here is 


particularly ripe for development and extension. 
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Re Poy Dr Xx =A 


THEORETICAL DEVELOPMENT OF THE EALANCE EQUATIONS 


In tais appendix theoretical considerations are outlined 
Which lead tc development of the systems of linear eguations 
whose soluticn yields the steady-state probabilities for the 


guéeuing models of interest. 


Assume that the system of interest can be described in 
terms of a finite number, say N, of states, and number the 
States frem cne to N. Assume further that time 1s measured 
from a point, t = 0, at which a change in the state of the 


System occurs. 


Define a random variable X(t) to be the state of the 
‘system at time t. By convention if a transition occurs at 
time t, x(t) is the state resulting Irom the transition, not 


fme State pricr to the transition. Also, define P (t) to 
1) 


be the prcbability tnat the system is found in state j at 


meme t given that it starts in state 1. That is, 


(A.1) Pp (t) = Prob{X(t) 27) 26S ay 


ij 


Define efochs, ee =O er oi Cuewie ce. De Cicut Ties 


71 2 
Memuhich transiticns cccur. Note that X(t) = X(t.) 1ft §& 
1 a 
=< t . Then the random variable T =t - tft. 1s the 
i+ i aL i-1 
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Meme cLetween epochs 1 - 1 and i. It is also the length of 
time that the system stays in state X(t ) after the 
sha 


(a-1)~-th efech. 


shag Batt ol = k, let a) be the cumulative distrikution 


om: / 


Memmetion for T. Assume that (for k = 1, 2, ..., N) F (0+) 
a K 


= Q0 and that T depends only on the state of the systen 
hl 
Meeween the ercchs 1 - 1 and i. That is, f is 


at 


stcchastically independent of Weecocnie to, eel VfOre j) @ 1.00 
J 


meee fOr j} #1 1. 
J 


Consider a network of queues in which at least two jobs 
can receive service simultaneously. Then, completion cf 
service of a job will very likely result in a change in the 
state of the systen. (Naturally, hypothetical examples can 
be devised in which this is not the case. However, in the 
more general caSes of interest here, this statement holds.) 
But, if a jok completes service while another job is 
receiving service, ruture time between epochs will be 
meeected, nct by the distribution of service time of this 
latter jok, kut by a conditicnal distribution of remaining 
service time. That is, future epochs may net be independent 
of history. However, an elegant theory resulting fron 
renewal arguments cannot be applied unless some guarantee 
Can be offered that the independence assumptions are 
Satisfied. If all service times (or at least the times 
between epochs) are exponentially distributed, these 
guarantees begin tc appear since the residual lifetime 
distributions are identicai to the service distributions. 
This is the so-called memoryless property of the exponential 


distribution. So the aim in modelling is the determination 


Pacis 








O@f States such that the time between epochs is distributed 


exponentially. 


So, assume that a system has been modelled such that, 


Mmermeecach 1 = 1, 2, .«.., N, 


oA. 2) F (xX) = 1- exp{-c (t) x] 
a. al 


where oo > 0 depends upon the age t of the process (i. 
e., the time Since + = 0) but not the time x Since the 
System last entered state 1. Note that this choice for 

a (x) Satisfies the assumption that eee) = 0. 

Furthermcre, the probability, oA ea that the’ system is 


found in state j at time t + h given that it is in state i 
at time t apfroaches zero if 1 # j, and one if 1= j, ash 
approaches zero. Since the probability that the systen 
transiticns from state i to other states and back to state i 


again in time h goes to zero as h approaches Zero, 
Beeeit,ctth) is approximately equal to exp{[-c (t)h] for small 
ak aL 


~N 


h and 


i. 3) ime i - S  (t,tth))] 7 h = c(t) 
al ale 
h-~>0 


mis 1S assumption 1 of Chapter XVII, secticn 9 of Feller 


mie }. 


Now, define q (t) to be the probability that, if the 
1) 
System changes state from state i at time t, it will 


Mmansiticn into state j; or, succinctly, 
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(A.4) ety = Propix(t ) = j | X(t ia andat. = t} 
2a k k k 


Note that g  (t) depends upon the age of the process but not 
1) 


the time the system is in state i. Assuming that q (t) is 


ij 
continuous, 
fA. 5) Paice (t,cth) / h] 
i 
h-->0 


lim [q _(t)F (h) / hb] 
a al 
h-~>0 


Cc (t)g (t) 
al sg 


memeong 25 i # j. This is Feller's assumpticn 2 (Chapter 
me, Section 9 of [18]). 


Based upcn these two assumptions (and a third assumption 
which is trivially satisfied here since the state space is 
finite) Feller derived the system of forward differential 
equations: 


A.6 aS Seo = t)°S Sure 
( ) ae )/ a ) ix! ) 


eS nase (Sy Cea nape ©) 
1) 5 Jk 
J#k 
This system cf equations leads to the system orf linear 
equations whcse solution vields the steady-state 


Pectabilities. 


mote that if s is fixed at zero, 


Pac | 





(A.7) S (0,t) = Prob{x(t) = j 1 ¥(0) = 43 = P(t) 
oy 13 


Hence, the system (A.6) becomes: 


A.8 Bi (t ew (oP y(t > £ 
(A.8) i ) a ) ik! ) ee ria’ PSS. 


j#k 


Suppose that there is some probability distribution 


N 
{v }. - for the state cf the system at time zero. That is, 
11> 


fOr each i, let v. = Prob{X(0) = i}. fThen, multiplying 
i 


(A.8) by v. and Summing over i: 
at 


a. 9 Gey = —Cc. (t)2 (t BO Oe t): t 
(A. 9) 7 ) otc a ee: = ak ey Hela ) 
J 


where met 1s the sum over i of the product er eae Dias 
> 1 


M= not tc say that the probability that X(t) = k is 
independent of the state X{0), but rather that the 


meconditicnal distribution are = Prob{X(t) = k} satisfies 
the same differential equation that the conditional 


Gistributicn satisfies. 


N 
Now, assume that a steady-state distribution SoU ee 


exists. Then, as t approaches infinity, Bae approaches a 


ena P*(t) approaches zero. an is the long run average 
k 
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percentage of time that the system is found in state k. If 
Meeis further found that gm has a limit c andgq (t) has 
jk 
a limit abe? then (A.9) becomes the system cf linear 
é 


equations, called the balance equations: 


(A. 10) c P = > cgq 
J 


k Kk ~ ik 
j#k eae 


From the interpretation given above for the distrikution 
| it is seen that 


11) So eee 


This is called the normality condition. 
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APPENDIX B 


ALGORITHMS OF CHAPTER II 


This appendix contains the algorithms referred to in 
Chapter II and is not intended to be read separately from 
Chapter II. Most of the algcrithms are written with FCHRTRAN 
prcegrammicg in mind. Many of them are accompanied by 
examples which demcnstrate their use step by step. In the 
examples Kcnran numerals in parentheses refer to ster numbers 
of the corresponding algorithm. Since many of the 
algorithms involve vectors, it 1S appropriate to remark that 
the compcnents of a vector are numbered from left to rignt 
Myeconventicr. Thus, the first component is the leftmest 


component and the last component is the rightmost. 


Beets ALGCRITHM 1: PereOGhArPH hee so. OUPNG ING OF tN TEGES 
VECTORS 


Algorithm 1is for the lexicographic sequencing of all 
ncnnegative integer vectors satisfying a coliection of 


Sonstraints. 


A nonnegative integer vector is Simply a vector all of 
whose compcnents are nonnegative integers. The algoritha 
Will work equally well on other types cf vectors so long as 
there is a cne-to-one mapping from the set of feasible 
values for tte components into the set of nonnegative 


integers. 
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The ccnstraints are simply a set of rules which prcvide 
some restricticn on the values the components may take on. 
It is assumed that the components have been numbered sc that 
the first application of any given component may be made at 
such a time that reference need be made only to the values 
of components to the left of the component affected. For 
example, a ccnstraint that the value of the first component 
must be’ eguai to the sum of the values of the second and 
third components will not explicitly affect the value cf the 
first component. Rather, the second component will be 
restricted to be less than or equal to the first, and the 
third component will be restricted to be egual to the 
difference between the first two. (For simplicity, "the 
i-th comrfonent" will often be used to mean "the value cf the 


i-th component" when the context permits.) 


Mareoughout this algorithm, k and m refer to component 
mambers; n is a counter which, at any point in application 
of the algorithm, indicates the number of vectors which have 
beeén enumerated to that point. All vectors are assumed to 


have fixed length K. 


ALGoritenn | 
feeeefet kK = 1, n = 0 and m= K. 
(ii) For each value of k from its current value through 
k = K, let the k-th component equal its smallest possille 


Value subject to the constraints. If this cannot be dcne, 


moO tO (Vv). 


feeeeinerease n byotsy The current vector is the n-th 


VECtor. 


(iv) If component m is at the largest value it can have 
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Mmeotatt Satisfy the constraints, go to (v). Otherwise, 
increase comfenent m to its next larger feasible value. If 
Me- RK, gO to (111). Otherwise, let k = m + 1, let mn = K, 
mma gO to (11). 


Meevecrease mt by t. If m> QO, go to (iv). Otherwise, 
all vectors satisfying the constraints have been enumerated. 
There aré n such vectors. STOP. 


Example E-1 


Prcblem: Entmerate all nonnegative integer vectors of 
length K = 3, whose first component is larger than the sun 
of the other two components, and the sum of whcse compcnents 


is no larceéer than 5. 


Ssoiution: 

(1) k = 13; n = 0; m = K = 3. 
(11) k=1: Since each of the second and third 
compenents can be no smaller than zero, and since 
the first ccmfonent must be larger than the sum of 
the cther two, the first component must be set 
equal tc cne. 

k=Z,3: The other two are set equal to Zero. 
erry mn = 1: the first vector is {1,0,0}. 
fevyethe third component is at the only value it 
can have and still satisfy the constraint that the 
Sum cf the second and third components be less 
Mian ethe Lirst. 
(v) m= 2. 
(av) The Seccnd component also cannot be changed 
withcut violating the constraints. 
(v) p= 1. 


(iv) Component 1 is increased to 2; k = m+1 = 2; a 
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en = 3. 

(21) k=Z,3: Eoth the second and third components 
are set egual to Zero. 

jema) m= 2+ the second vector is {2,0,0}. 
(iv) The third component is set egual to 1. 
Peep en = 3; the third vector is {2,0,1}. 
(iv) No change. 

(v) D= 2d. 

fey) Ccmecnent 2 = 1; k = 3; m = 3. 

fay Cempenent 3 = Q. 

fi) n= 4; {2,1,0}. 


{v) No change. 


(v) @w@ = 2. 

(iv) No change. 

(v) op = 1. 

(iv) Ccmponent 1 = 3; k = 2; m = 3. 
ra) K=2,3: components 2 and 3 = Q. 
met) n= 5; {3,0,0}. 

(lv) Component 3 = 1. 


meme = 6; {3,0,1}. 

fey) Ccmeonent 3 = 2. 

meen = 7; {3,0,2}. 

(iv) No change. 

(v) b= Zz. 

Gevy Gemronent 2 = 1; k = 3; a = 3. 
(11) k=3: component 3 = 0. 

ommieen = 8: {3,71,0}. 


Repeated application yields: 
n= 9 (3771, 1} n=10 [Seu n=11 {4,0 ,0} 
M=12 £{(4,0,17} n=13 (aon n=14 {5,0,0} 


Nore, ter example, that {4,0,2} is not a valid vector 
Since the sur of the components exceeds 5. Also, note that 
if the braces and commas are dropped, the vectors, 


considered as three-digit numbers, are in numerical order. 
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Mies 1S Characteristic of lexicographic ordering of 
nonnegative integer vectors. Algorithm 2 provides a method 
of creating a three-digit number from a nonnegative integer 


vector of length three. 


B.Z. ALGCRITIHM 2: TRANSLATION OF A VECTOR OF LENGTH K 
INIO A K-LIGIT NUMBER 


Algorithmj 21s a computationally efficient method cf 
Mmeaistating a vector of length K into a K-digit number. It 
is assumed that each component of the vector is a 
nonnegative integer less than ten. Throughout the algorithn 
k refers to a component number and m is used to accumulate 


the K-digit rumber. 


AlGorith oa 2 


Cee Let m = 0. 


(ii) For cach value of k from one through K, multifly o 
by 10 and add the value of component k to get a new value 


mor mM. 


Example E-2 


Meepiem: Translate {1,0,5,5,9} into a five-digit number. 


Seiution: 
(1) go = 0. 
Cemex — ts no = 0x10 + 1 = 1 
k=2: a 1x10 + 0 = 10 
k=3: ao 10x10 + 5 = 105 
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~~ 
I! 
B say 
ee 
=) 
i! 


PS etOe+ 5 = 1055 
Imex oer 9° = 9 10559 


@e 
B 
tl 


Using different base number systems, the restricticn 
that the digits te smaller than ten can be relaxed. Fer 
example, using 100 in the place of 10, the vector {10,9,83} 
would be translated into: 100988. 


Using a med function, this procedure can be reversed to 
translate a given number inte the corresponding vector if 


the number krasé is given. 


feos ALGORITHM 3: SHORAGE OF RIGHT SUBVECTORS 


Algorithm 3 efficiently stores the right subvectors in 
an array KSTG without generating and translating them. Each 
sukvector is stored as a number (as though Algorithm 2 had 
been applied to the vector representations). Recall that 
each right sukvector 1S a nonnegative integer vector of 
length M, the number of PP's, and that the sum of the 
components of each right subvector cannot exceed N, the 
total number of jobs circulating in the system. The 
algorithm requires the use of two auxiliary vectors, NSTG1 
and NSTG2, each of length N. The numbers stcred in KSTIG may 
be separated into groups according to the sum of the digits. 
Since the zere group contains only the number zero, it is 
not stored. NSTG1 contains pointers to the beginning cf 
Maen group; and NSTG2 contains pointers to the end of each 
Mmeeto. Thus, NSTG2({i) = NSTG1(it+1) - 1. 
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AVgorichm 3 


oeeset NSOTGI{1) = 1, and for « = 2,3,-...,N, let 


NSTG1(k) = NSTG1(k-1) + C . 
fle 2h.) ea 


Omer or Kk = t,2,...,N, let KSTG(NSTG1(k)) = k and 
NSTG2 (k) =—meNolG) (Kk). Let m = 10 and k = 2. 


(lii) Increase NSTG2(1) by 1, and let KSTG(NSTG2(1)) = 


(iv) Let i = NSTG2(k) + 1 and j = NSTG1(k-1). 
Motet KSTG(i) = KSTG(j) + o. 


ays lt j > NSTG2(k-~1), go to (vii). Otherwise, 


increase 1 and j each by 1 and go to ({v). 


femiy Let NSTG2(k) = 1. If k 2 N, go to (viii). 


Otherwise, increase kK by 1 and go to (iv). 
(viii) If NSTG2(1) + 1 < NSTG1(2), multiply m by 10, let 


kK = 2, and co to (iii). Otherwise, all right subvectors 
have been stored in KSTG. STOP. 


Example &-3 


{ 
Ud 


Pecblem: Stcre the right subvectors in a case with N 
jobs and M = 3 PPP's, 


Soiution: 
(i) NSTG1(1) 
G+ 6 = 10. 
Gunes sTG (1) 


1+ 3 = 4, NSTG1 (3) 


1, NSTG1 (2) 


iT) 
a 


teens tG 2 (1) 
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oumerta je = 2,0 NSTG2Z (2) = 4 
KS1G(10) = 3, NSTG2 (3) 
may NSTG2(1) = 2, KSTG (2) 
ivy 1 = 5, J = 1 
(v) KSTG(5) 
i) i = 6, 
(v) KSTG (6) 10 + 10 = 20 
(vi) no changes 
(vii) NSTG2(2) 6, 


il il 

hee 

oe Be, 
« 


UI 
aS 
+ 
—_ 
© 
it 
ay 
_ 


Ld. 
li 


Ul 
a 

i 
lw 


fey) a = 11, j = 
{(v) KSTG (11) 
fyi) 2 = 12, 
(v) KSTG(12) 
iw) 1 = 13, 
(v) KSTG(13) 
(vi) no changes 

(vii) NSTG2(3) = 13 

(viii) m = 100, kK = 2 

fey NSTG2(1) = 3, KSTG(3) = 100 
(iv) 1 = 7, j = 1 

(v) KSTG (7) 101 

fae i = 8, j = 2 

(v) KSTG (8) 110 

Way lL = 9, j = 3 

(v) KSTG (9) 200 

(vi) no Changes 
(vii) NSTG2 (2) 
(iv) 1 = 14, j = 4 


iT 
ho 
+ 

Ss 
© 
i 


12 


dot | | 
i it NO Il 
ap) => 

OV Ut 


, 
LO 

a 
~ 

( 
tw 


(v) KSTG(14) = 102 
(vi) i = 15, 3 = 5 
feeeotG (15) = 111 
Gay = 16, j = 6 
(v) KSTG(16) = 120 
Gey = 17, j = 7 
faeesec 7) = 201 


(Vea = 18, j = & 


20) 4/ 





(v) KSTG(18) 210 

ia) i = 19, jf = 9 

(v) KSTG(19) 20:0 

(vi) no changes 

(vii) NSTG2(3) = 19 

(viii) STOP 
meeeresulting KSTG vector is {1, 10, 100, 2, 11, 20, 101, 
mum, 3, 1I2, 21, 30, 102, 111, 120, 201, 210, 300}. 
NSTG1 
NSTG2 = {3, S$, 19} points to the end of each group. 


{1, 4, 10} points to the beginning cf each group and 


B.4. ALGCRITHM 4: DETERULENATEON OF SGORAGE LOCATION iN 
i> 1G 


Algorithm 4 allows determination of the storage loaction 
mma given left subvector from the vector representaticn 
Megete,. This precludes the necessity cf translating the 
left subvectcr into a number (Say, uSing Algorithm 2) and 
Meang a search through LSTG. Recall that ee is the number 


of ones and LB the number of twos in the left Subvector. 
Throughout the algorithm j refers to the component numters 


Ot the left subvector, m refers to locations in LSTG, and i 


Methe value cf the j-th component of the left subvector. 


Algorithm 4 


1 and j= 1. 


eee) (CN Ute = N, D 


Mmeeeiet 12 be the value of the j-th compenent oz the 


Mett subvectclr. 


SU 





ery ir 1 = 2, gO to (iv). Otherwise, decrease L by 
1 


i tf e, is hegative, go to (vi). Otherwise, go to (v). 


(iv) Increase m by C - . Decrease e Dy. 2 
+ ’ 
1 2 = 1 


lige > Meawrositive, go to (v). Otherwise, go to (vi). 


fv increase } by 1. Go to (ii). 


(vi) The current value of ma is the desired location 


mamper. STOE. 
Example 5-4 


Problem: With JF = 2 and Y =—Zetingdstne locaraon of 


mie, 2, )} in LSTG. (See exanole 2.9 in Chapter Ii) 


Solution: 
fe) 1 
1 


r 
a 
be 
\ 
N) 
a 
= 
T 
as 
= 
M 
os 


It 
cred 
e 


(ii) i 
(iii) L = 0. 


(v) J = 2. 

fay. = 2. 

(iv) nm = 141+ 1= 2; L = 0. 
2 

ej = 3. 

(ii) 1 = 2. 

eee 1 3; t= Ol 


fveyetne location is n = 3. STOP. 
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mow) «ALGORITHM 5: STORAGE OF VARITABLE-LENGTH LEFT 
SuevECTORS IN ISTATEm1 ORDER 


Algorithm 5 is for storage of the variable-length left 
subvectors wken the states are ordered according to a 
lexicographic crdering of the ISTATEm1 vector 
representaticn. Throughout the algorithm k is the length of 
the subvectors being stored, m is the location in LSTG of 
the last subvector stored, 11S used aS an index, j points 
to the end of a bleck cf stored subvectors having common 
length, and NO 1S a scratch array used to store the number 
of ones in the vector stored in the corresponding position 
SeeissG. While storing the left subvectors in LSTG, the 
algorithm stores pointers in NSTG2. At completion of the 
megOrithm cemponent NSTG2(k) + 1 of LSTG will contain the 
first vector and ccmponent NSTG2(k+1) the last vector of 


length k. Lis the number of servers at the CPU. 


ALgoriehm 5 


oy tet k = max(1,N-L). This is the smallest number of 
Mmegats 1 any number to be stored in LSTG. Fori= 1, 2, 
mene, K, Let NSTG2(i) = 0. Also, let mn = 0. Use Algorithna 1 
to sequentially generate all vectors of length k consisting 


solely of ones and twos with no more than N- ones and N 
1 
Mmeos. Fach time a new vector is generated, increase m by 


Mmemetranslate the vectcr into a k-digit number, and store 
mime number in LSTG(m). Also, store in NO(m) the number ot 


ones in LSTG(m). Let i = OQ. 


(ii) Increase k by one. Store the value of m in 
WS5iG2(k). If k = N, both LSTG and NSTG2 are complete. 
STOF. Otherwise, let j = m and proceed. 
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mere Eherease 2 by one. Let a = LSTG(i) and b = NO{(i). 


i b = ae go to (iv). Otherwise, increase m by one and let 


Mere({m) = a x 10 + 1. If k is less than N, let NO(m) = b + 
ieeotherwise, let NO{m) = b. If k- b=WN, go to (Vv). 
Z 


Otherwise, preceed. 


(iv) Increase m by one and let LSTG(m) = ax10+ 2. 
Let NO(m) = E. 


M@peetf 2 1S less than j, go to (iii). Otherwise, go to 
fi). 


For an example see Example 2.11(a) in Chapter II. 


Beo. ALGCRITHM 6; DETERMINATION OF NSTG4Y FROM NSTG1 AND 
NSTG2 


Algorithm 6 is for determination of the values required 
in the vector NSTG4Y from the values already stored in NSTG1 
and NSTGZ. 


ALGOrLtthm 6 


feemeoect 2 = 1 and k = max(0,N-L). if k = 0, let 
NSTG4 (1) = 1. Otherwise, let NSTG4(1) = NSTG2(k+1) - 
NSTG2(k). 


(ii) Let a = NSTG1(it1) - NSTG1(i). Let k = max(i,N-L) 


and increase i by one. Let NSTG4(i) = a x [NSTG2(k+1) - 
NSTG2 (k) 1, 


a 





ferry rt i < WN, go to (ii). Otherwise, NSTG4 is 
ccmplete. STOP. 


Example E-5 


meeokem-s A case with L=N = =2andN =3 is 
1 2 
considered ir Example 2.11 of Chapter II. From part (a) it 


meocen that NSTG? = {1, 3, 6, 10, 15, 21} and NSTG2 = {0, 
Seo, 7, i7, 273}. Determine NSTG&. 


Sesution: 
(1) 1 = 1;k = 3; NSTG4(1) =7-+0e= 7. 


medi s 3 —- 1 = 2; k = 3: i = 2; NSTGH(2) = 227+7 
= 21. 

jeer a = 3; k = 3; 1 = 33; NWSTG4(3) = 42. 

me a = 4° k = 3; i = 4: NSTGY (4) = 70. 

miayead —- 5, kK = 4; i = 53; NSTG4 (5) = 120. 

(111) NSTG4 is complete. STOP. 


B./. ALGORITHM 7: STORAGE FOr VERE AR LES LENGE Le rT 
mov ECTORS IN ISTATEm2 ORDER 


Algorithm 7 is for storage of the variable-length left 
Subvectors when the states are ordered according to a 
lexicographic crdering of the ISTATEm2 vector 
representaticn. Throughout the algorithm r is the location 
in LSTG where the next subvector is to be stored, s is the 
location in NSTG3 where the last number was stored, and t is 
the length of the vectors being stored (also, the iccaticn 
in NSTG2 where the last number was stored). For each s 


NSIG3(s) is a location in LSTG where either the number of 


8) | 









mmgees, the number of ones, cr both change. For each t 
NSI1G3 (NSTG2(t)) is the location in LSTG of the first 
surkvector of lengta t. Past (11) 1 is the location in LSTG 
of the subvector to be considered next for generating 
ancther subvector. Control is maintained in the algorithn 


With the aid cf j and ao. 


Algoritha 7 


(i) Set NSTG2(N) = 1, NSIG3(1) = 1, r = 1, s = 2 and t = 
i 1. 


(11) In lexicographic order generate all vectors of 
Mength N consisting of a7 ones and N twos. Each time a new 
2 
vector is generated, translate it to a number, store the 


nugber in LSIG(r), and increase r by 1. Set NSTG3(S) = Cc. 


men) Set NSTG2(t) = s, m = S and j = NSTG2(t+1). Set il 
= NSTG3(j) and increase j by 1. 


eye Lt LSTG(i) is even, set LSTG(r) = [LSTG(1i)/10 ], 
where [a] is the largest integer less than cr equal toa, 


and increase r by 1. In either case, increase 1 by 1. 


Ware 2 < NSTG3(j), go to (iv). If NSTG3(s) = ©, go to 
(vi). Otherwise, increase s by 1, and set NSTG3(sS) = C. 


feemettei se tm, gO to (Vii). Otherwise, increase jj by t, 


and go tc (iv). 
(¥ii) Set i = NSTG3(j-1).- 


(melt £S7G (i) is odd, set LSTG(r) = ( ESiG) 7 104), 


Bnd increase cr by 1. In either case, increase i by 1}. 
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eet NS1G3(j), go to (vili). I£ NSTG3(s) = 4, go 
momax). Otherwise, increase s by 1, and set NSTG3(s) = cr. 

oo if t s Boe }) 2 go to (xi). Otherwise, decrease 
Mmeyet, and cc to (iii). 

(x1) if LSTG(r) has been set, increase r and s each by 
1, and set NSTG3(s) = Cc. 

oer) If L 2 a ee go cO8(xXi?in). Othervise, set 


NSTG2(t) = xr for t = Cage (h Skat ys 
(X1i1i) The procedure is complete. STOP. 
Example E-6 


Preblem: Store the left subvectors in ISTATEm2 order for 
the case that e = 2, a =o = oS and ALFACI21) = 0. 


Sojution: (Steps in which no variable changes value are not 
listed.) 

Cy) NSTGZ(4) = 1; NSTG3(1) = 13; c = 1; S = 2; t = 

ce 

(ii) (Use Algorithms 1 and 2) 


MoOuGhGM= 1122: c= 2 

mstGe2 = iziz; crc = 3 

ome =. 221: cr = 94 

iowa =n2di2; c = 5 

Bete (>) = 2121; r = 6 

msmero) = 2217; cr = 73; NSTG3(2) = 7. 
(emomersrGl(3) = 2; m = 2; j = t; i = 1; j = 2. 
(iv) Since LSTG(1) is even, LSTG(7) = 112; © = 8; 
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fe 2. 

ev) LoiG(s8) = 12%; r = 9: i = 3. 
(iv) 1 = 4& (LSTG(3) is odd). 

Mey) LSIG(9) = 211; r = 10: i= 5. 
fry) 1 = 6. 

ovy i = 7, 

fomec = 3; NSTG3(3) = 10. 

(vii) i = 1. 

(vili) 1 = 2. 

Orit) i = 3. 

meer LSTG(10) = 122; r= 713; i = 4. 
Meii)y"1 = 5. 

(viii) LSTG(11) = 212; r = 12; i = 
fee) LSTG(12) = 221; cr = 13; i = 
fees = 4; NSTG3 (4) = 13. 

i) t = 2. 

(iii) NSTG2(2) = 43; am = 43; j = 23; 1 = 7; 
emy) LSTG(13) = 17; r = 14; 1 = 8. 
fy) 12 = 9. 

(1vV) 1 = 10. 

mos) = 5S; NSTG3(5) = 14. 

(vi) j = 4. 

fey bSIG (V4) = 12; cr = 153; 1 = 11. 
mevye iota (15) = 21; r = 163; 1 = 12. 
fiyje i = 13. 

fry) = = 6; NSTG3(6) = 16. 

(vid) 2 = 10. 

(oat) 1 = 11. 

@ilsy) i = 12. 

(viii) ISTG{16) = 22; rc = 173; 1 = 13. 
(ix) s = 7; NSTG3(7) = 17. 

fea t= 1. 

meee nStTeGl (1) = 7; 2 = 73.4 = 45 1 = 13; 
(iv) 1 = 14. 

awe) ag = 6. 

fPamerSiG(i7) = 1; cr = 18; i = 15. 


oS 





ory) i = 16. 
(v) s = 8; NSTG3(8) = 18. 
mye LSIG(78) = 2; r = 19: i = 17. 


(vi) j = 7. 

(v) s = 9; NSTG3(9) = 19. 
(vii) 1 = 16. 

Wai) i = 17. 


(2ia2) STOP. 


meee ALGCRITHM 8: DETERMINATION OF RELATIVE PCSITION OF A 
Pan SUBVECTOR 


Algorithm 8 is for determination of the relative 
position of a far subvector among all far subvectors which 
are valid for given right and left subvectors. MAX is a 
vector which gives tne maximum values which the conponent of 
the far subvector may take on. That is, the k-th compcnent 
of the far subvector can be no larger than MAX ({(k). 
Throughout the algorithm n is used to accumulate the 
relative fosition of the given far subyvector and k and om are 
Meed tO direct control of the algorithm. Recall that MAX (k) 
Seedy CODVention ii there is no job corresponding to the 
k-th compenent of the far subvector. This will be 


illustrated in the example following the algorithn. 


RigorLtenn 3 


(1) Set n = 1 and k = 1. 


(ii) Set m equal to one less than the value of the k-th 


ccmponent of the given far subvector. If m@ = 0 or k = K, go 


mo {iv). 
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Mme FOr 1 = k+l, k+2, ..., K, multiply m by MAX{i). 


meee tnczrease n by m and k by 1. If k S$ K, go to (ii). 


Otherwise, nis the desired number. STOP. 


Example E-7 


Problem: Suprose Ms = = M= 2. Further suppose that 


€ach gueue has a single server and a FCFS queuing 


discipline. Finally, suppose that the service distributions 
are two-stage Erlang distributions for type-one jobs and 
three-stage Erlang distributions for type-two jobs at éach 
queue. Determine the relative position of {1,2,3} among all 
far subvectors which are valid for a left subvector 

Mee, !,2} and a right subvector {0,1}. 


Solution: Since there are no jobs at PP1, MAX(2) = 1 Ey 
Convention. Since a type-one job is in service at PP2, 
MAX(2) = 2. Since there is a type-two job in service at the 
meu, MAX(3) = 3. 

Cyn = 1; .k = 1. 


(ra) pm = 0. 

feyyen = 1; k = 2. 

ay m = 1. 

(iii) i = 3: m=ttx3 = 3. 

(iv) n=1+ 32 4; k = 3. 

(a) m = 2. 

fave = 49+ 2 = 6; k = 43; this 1s the sixth far 


subvectcr for the given left and right subvectors. 
(Nowe that the first five are; folie. Ulieea (ely. lip 2 ey 
mips, (1,2, 1}, and {1,2,2}.) 
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fee «=XOALGORITHM 9: DETERMINATION OF STATE NUMBER OF 
VECTORS WITH A FAR SUBYVECTOR 


Algorithi 9 is fcr determinaticn of the state number 
from the vector representation of a state when that vector 
representaticn has a far supvector. This algorithm uses 
Meee {in which the right subvectors are stored), LSTG {in 
which the left subvectors are stored) and NSTG4. NSTG4 is 
defined by: NSTG4{i) 1s the total number of states 
preceding tke first state having KSTG(i) as its right 
subvector. Throughout the algorithm i indicates the 
Meeation in KSIG at which the current right subvector is 
stcred, j indicates the location in LSTG at which the left 
[mavyecCtOr is stored, k indicates a location in LSTG, and n 
is used tc accumulate the state number. The meaning of MAX 


is given in the discussion of Algorithm 8. 


Abgoma thie? 


(i) Let i and j be the integers such that KSTG(1i) is the 
megnt subvector and LSIG(j) is the left subvector of tne 
given state. Let k be the smaliest integer such that 
LSTG(k) is a valid left subvectcr for the given right 
subvector. Let n = NSTG4(i). 


(ii) Form the MAX vector to accompany KSTG(i) and 
Muneerky. if k = 3, go to (iv). Otherwise, increase n by 
the product cf the components of the MAX vector. 

m@eeieeinucrease K py 1, and co to (11). 

fmaeuse Algorithm 8 to determine the relative position 


of the far sukvector of the given state among all far 


SutEvectors which are valid for KSTG(i) and LSTG(j). 


ee 6. 





Maerease n ty this number. The value of n is the state 
number of the given state. STOP. 


Example E-8 


Problem: Consider the system discussed in Example B-7. 
Find the state number for the state whose vector 
representaticn has right subvector {0,1}, left subvectcr 
M2, ',2} and far subvector {1,2,3}. 


Memrieon: KSIG = {1, 10, 2, 11, 20, 3, 12, 21, 30, &, 13, 
See, 40} and LSITG = {1122, 1212, 1221, 2112, 2121, 2211}. 
Each left subvector can be used with each right subvector. 
Although all fourteen values in NSTG4 could be determined, 
cnly NSTG4(1) is needed. The only states preceding the 
first state having KSTG(1) as right subvector are those with 
all jobs at the CPU. From LSTG it 1s seen that three of 
these states have a type-one job in service and three have a 
type-two job in service. Tne feasible far subvectors for 
meeneieft subvector are {1,1,1}, {1,1,2} and, 1f£f a typée-two 
mets in service, {1,1,3}. Thus, NSTG4(1) = 3x2 + 3x3 = 
Bi .. 

meee = 15 Jj = 2: k = 13 n = 15. 

meyeeMmaAxX = {1,2,33}; n = 15 + 6 = 21. 

fera) Kk = 2. 

emyeeax = {1,2,3}. 

(v) Ey Example B-7 the relative position of tae 

far subvector is 6. Thus, the state number is n = 


ye +O = 2Z/. STOP. 
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mepiG. ALGCRITHM 10: CALCULATION OF STATE NUMBER FOR 
Sreinbs WITH ELOCKING SUBVECTOR 


Algorithsr 10 is for determination of the state numcter 
from the ISTATEm? or ISTATEm2 vector representation when 
this vectcr representation includes a blocking subvectcr. 

As usual, KSTG contains the right subvectors and LSTG, the 
left subvectcrs. NSTG4(i) is the number of states preceding 
the first state having KSTG(i) as right subvector. In this 
algcrithm i is the number of blocking subvectors associated 
With the given right subvector, and j is the position cf the 


given blocking subvector among then. 


Algorithm 10 


(1) Find the integers r and s such that the right 
Subvector is KSTG(r) and the left subvector 1s LSTG(s). Let 
Merce the integer such that LSTG(t) is the first valid left 
emovectcr for KSTG{r). (In the case considered in 
Subsecticn 3.8 of Chapter II, t = 1.) Let k equal the sum 
of the components and m the numoer of nonzere components of 


the right sukvector. 


moet r kK = N - C, go to (iii). Otherwise, set 1 = 1 


and j = 1. Ge to (iv). 


(iii) Let b be the binary number which corresponds to 


m 
Mme {shortened) blocking subvector. Set i=2 and j=i+ 


the decimal equivalent of b. 


{iv) The state number is NSTG4(r) + ix(s - t) + j. 
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Example E-9 


Problem: In the case that ae = — = C = 2 and MM = 3 £ind 
the state number of the state whose ISTATEm1 vector 


Meeeeesentaticn is {2, 1, 0, 1, 2, 1, 1, 2, 1, 0, 0}. 


Seeemeron: in this case KSTG = {2, 11, 2, 101, 110, 200, 3, 
See, OU, 102, 111, 120, 201, 210, 300, 4, 13, 22, 31, 40, 
Smeti2, i2i, 120, 202, 211, 220, 301, 310, 400}. Note 
that 10, for example, is not included in KSTG since the 
number of joks at the PP's can be no smaller than N - C = 2. 
Meee LolG = {1122, 1212, 1221, 2112, 2121, 22113. For the 
Mate given the right subvector is {1,0,1}, corresponding to 
KRSiG(4); the left subvector is {2,1,1,2}, corresponding to 
Meome(4); and the blocking subvector is {1,0,0}, 
corresponding to a binary 10 or a decimal 2. Since the 
Mength of LSTG is 6 and since the first three right 
survectors have, respectively, one, two and one nonzerc 
1 2 1 

digits, NSTG4(4) = 6x (2 +2 +2) = 48. 

(i) cr=43; s =43 t = 13; k = 23 o = 2. 


2 
Mery b= 10; 2 = 2 = 4; j = 1+ 25 3. 
(iv) The state number is 48 + 4x(4-1) + 3 = 63. 
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APPENDIX C 


meee LUCTETLITY AND PERIODICITY IN CENTRAL-SERVER MCDELS 


Pie this appendix irreducibility is exhibited for a large 
Medes Of Central-server models. The technique is one of 
maagtcating a string of feasible transitions from an 
arbitrary state A to anotner arbitrary state B. In this way 
it is seen that the associated Markov chain is irreducible. 
In addition, the periodic nature of many central-server 


models is €xamined. 


Consider a central-server nodel (Pigure 1.1) consisting 
of a central server (queue M + 1), hereafter referred to as 
the CPU, and M 2 2 other queues, hereafter referred to as 
PP1, PP2, .--, PEM. Suppose that there are I job types and 


Meee cor ¢ach i = i, 2, ..-, I, there are N. > 0 jobs cf 
a 


mype 1 circulating in the system. Then the total number of 


jors, N, circulating in the system is 


foe 


Mereeach i = 1, 2, ---, I and each j = 1, 2, «-.-, MN, Let Ps 
Me the branching probability of type-i jobs to PPj after 
Completicn of service at the CPU. Since the network is 


clcesed, 


o22 








= 


mmecdadch 1 = 1, 2, ..., I. 


Let A and B be any feasikle states of the systen. 
Denote state BE py 


B = ee O eoprana cue a mere cee 2) 
( 1 at t 4 yn’ 17 t 4 ) 


M 


where (as in Chapter ITI) a 15 the number cof jobs at PE J in 
State 3, and the subvector B! = (Care) is a 
permutaticn cf Ye qnes, as WO Sian peseceus i I's, such that the 
earst yy ccmrponents of B' list the job types cf jobs at PP1, 
the next n ccmponents list those at PP2, and so forth. The 
fast a = le - — oe S a components of B*' list the job 


types of joks at the CFU. The subvector of Bt correspcending 


to €ach gueuve shculd represent the job types of jobs at that 
gueue in an cider of arrival appropriate to the state E and 


the queuing discipline at the queue. For example, suppose 
os = 3 and PE1 contains one job each of types i, 2, and 3. 
If PP1 has a EFS or IS queuing discipline, eer ee can be 


any permutaticn of (1,2,3). However, if PP1 has a FCFS 


Sucuing discipline and the type-2 job is in service, the 


type-1 jok next and the type-3 job iast in state 8, then 


Merb ,b ) mest be (2,1,3) . 
m2 3 
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It is easily seen that the representation given abcve 
May not be unigue. However, uniqueness of representation is 
not important for the proofs which follow. State A can be 
similarly represented. But this, too, is not important to 
mre LOlicwing proofs. 

meorem C>1 Suppose that the CPU has a FCFS queuing 
discipline and a single server, that all queues have 
infinite capacity and exponential servers, and that I < M 


and the gueues can be numbered so that p. #0 for i= 1, 2, 
ad. 


Meet. (that is, jobs of type 1 are allowed to route to 


PPi.) Then, the system is irreducible. 


Boot: Consider arbitrary states A and B as described 
above, and start in state A. State B results from the 


fcllowing sequence of feasible transitions: 


1. Cne at a time route all jobs at the PP's to 
the CPU. 

2. One at a time route all jobs from the CPU to 
mene PP*'s sc that, for each 1 = 1, 2, .«s, I, 
all type-i jobs route to PPi. 

Pee rOrsk = 1, route a be JOo irom ae to 


tke CPU. Repeat with k = 2, then k = 3, and so 


pont hn to kK = N. 
4. Now route the first 7 jobs to PP1l, the next 


n jobs to PP2, and so forth, leaving the last 
a 


Bp jCES at the CPU. 
c 


morollary C-1-A Theorem C-1 still holds if the CPU has 


multiple servers, cr if the CPU has any of the following 


queuing disciplines: IS, PS, LCFS, LCFSPH. 
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Proof: Ike sequence of events given above will work in 
each of these cases (with obvious changes in arrival of jobs 
at the CPU in ster 3 for LCFS and LCFSPR queuing 
disciplines). 


Samollary C-1i-P Theorem C-1 still holds if the CEU has 
a class friority jyueuing discipline provided the PP's can be 
chosen sc that the gueuing disciplines at PP1, PP2, ..., PPI 
meen LoS, FCFS cr PS. 


: The seyuence of events given arcve will werk if 


each o hese rsct N - n jobs routed to the CPU in ster 3 is 


S 
immediately reuted to the appropriate PP. Step 4 is net 
needed. 


Meeollary C-~1-C Theorem C~1 still holds if the various 
gué€ues have ceneralized Erlangian service distributions and 
mmienedgueuc has either a FCFS, LCFS, IS or PS queuing 


discipline. 


Proof: To the sequence of events given above add: 
5. Advance each job in service to its appropriate 


stage of service. 


Note that many cther corollaries are possible. Several 
M@ieethese should be obvious to the reader. For example, 
generalized Erlangian service distributions are possible 
with LCFSPR, LCFSPRpt and class priority queuing disciplines 
prcvided strict attention is paid to the order of arrival of 
jobs and advancement of jobs to the proper stages of 
setvice. Also, finite capacities are possible provided PPi, 
Mme, PPI can te ckosen so that the capacity at PPi is at 


least as large as N +n. Rather than consider details or 
an 1 





Mmmemer corollaries to Theorem C-1, consider the following 


theoren. 


mueorem C-2 Suppose that the PP's can be numbered so 


that ee mmr ow 1! —- oh, 2, «22, Ls “Purther stppose that for 
at 


Paen i there is a j # 1 such that p. #0, and that each of 
1) 
FP1 and CPU is a single server FCFS queve with infinite 


Capacity. Then the system is irreducible. 


PrEoot: AGain, Start in state A. State B results ftom 


the following sequence of feasible transiticns: 


ieeeone at a time route all jobs at the PP's to 
the CFU. 

2. For k = 1, route the job in service at the CPU 
momPe tl if 1t is of type 2 Route it to PPj 


mer ccme i * 1 and then back to the CPU 1z it 
is net of type b . Repeat this procedure until 


FE1 ccntains exactly k jobs. 

Beerepeat step 2 for k = 2, then for k = 3, and 
SeeroOrth up to k = N. 

tee one at a time route all jobs from PP1 to che 
CFU. 

Eeeeenoute the first oe jobs tae PE, enesnex. 28 


jobs to PP2, and so forth, leaving the last n 
Cc 


fjietemat. tne CPU. 


AS with ZIheorem C-1, many corollaries can be stated and 
proved. Rather than dcing sc, simply note that 
irreducibility of the three models discussed in Chapter IV 


as having been programmed is assured by these theorems and 





their ccrcllaries provided there are at least two PP's to 


which joks can route. 


Theorem C-3 fia Service GrstriDueLons tare 


exponential, ¢€ach state of the resulting Markov chain which 


can be reentered is periodic with an even period. 


Beoot: Consider a seguence of states resulting from a 


feasible sequence or transitions, beginning and ending with 


0 1 2 k~1 k 


suffice to shcw that k must be even. 
Define a function f from the state space into 


the set cf ncnnegative integers by: 


£(A) = n fA 


where n is the number of jots at the CPU in state A and n 
(os 


is the number of blocked servers throughout the network in 


State A. 


Recetas On f£FOM sa. COs can only take 
jo et 
place when a jcb completes service at some gueuve. If the 


job cannct mcve, the server which was servicing it beccmes 


blocked; i. e€., n is increased by one and n remains the 
D c 


same. 


If the job can move, and if no server was 
blocked because of the finite capacity at the queue at which 
service was just completed, then only the one job wiil move. 
Because of the structure of the central-server model, the 


result will -e either an increase or a decrease sil: Bae ey 
Cc 


cne. The value of n wiil remain unchanged. 
b 
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If, on the other hand, the movement of this 
job “unbiccks" a server at another queue, two or more jobs 
will move Simultaneously. Because of the structure of the 
central-server model, each of these jobs will move either 
toward the CFU or away from the CPU, resulting in a change 


of one in the value of n for each job which moves. (Since 
Cc 


some of these changes are positive and others are negative, 
the net chance in the value of n is no more than one in 
c 


absolute value.) For each job which moves, except the jcb 


which completes service to initiate the transition, a server 


is unblocked, decreasing ae by one. Thus, the change inn 
E 


@egeeeis cne fcr the jok which completes service and either 
D 


minus two or zero for each of the other jobs. The net 


change is therefore odd. 
Since the net change inn + a LS odd ne 
os 
matter what the circumstances of the transition, f(A. ) 
J+ 


must be even if f(A ) is odd, or odd if oie is even. 
Considering the seguence of transitions given above, if f(B) 
is even, £(A ) is even for even j and odd for odd j. If 
£(B) is odd, £({A_) is odd for even j and even  OUnan) Cd big 


Since aa =D; ae =—f{(ejer Hence, k mUSt be even. 


Since the author is interested in steady-state 
solutions, tke principle concern is systems which contain no 
absorbing states. Thus, the following conclusion to Theoren 
C-3 would be more to the point: "the resuiting Markcv 
chain, if it contains no absorbing states, is periodic with 
even period." In some cases, as is seen in the rollowing 


thecrem, more specific results can be derived. 
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Theorem C-4 If ali service distributions are 
exponential and there is a feasible state B such that the 
CPU 1s idle and some PP has cnly one type of job, then state 
B has period two. 

Proof: Suppose that PPj ccntains only jobs of tyre i. 
Then, if a jcb completes service at PPj, the systen 
Beansitions tc a state A identical to B except that there is 
a job of type i at the CPU and one less job at PPj. From A 
the system may transition back into B if the job at CPU 
completes service and routes to PPj. (Note that the 
branching prckability of type-i jobs to PPj cannot be zero 
Since state E is feasible.) Thus, the period of B is no 
larger than two. By Theorem C-3, the period of B is even. 


Thus, this period is two. 


The importance of Theorem C-4 is quickly seen fcr sacdels 
Which alsc satisry the hypotheses of Theorem C-1, Theoren 
C-2 or one of their corollaries. The result is a Markcy 


chain of period two since irreducibility is also previded. 


Generalizaticns of Theorems C-3 and C-4 are possible in 
certain mcdels with nonexponential service distributions. 
For example, if the CPU has two-stage Erlang service 
distributions, and if all PP's have exponential service 
distributions, the period is divisible by three. On the 
other hand, aperiodic states result from many generalized 
EXlangian service distributions (since the job may comglete 
service at any stage) or from Erlang service distributions 
With relatively prime numbers of stages at, say, different 


PP‘s, 
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APPENDIX G 


GLOSSARY CF MAJOR VARIABLE NAMES IN THE THREE PROGHAMS 


ALFA 


eGrF 


1 
2 @) 
Cc 


IAB 


ee DE X 


PEE AL 


Plier x USeCatONSeOne tae branching probabilities. 
Perna hS Lac PEOoaDIIIty that-a type-2 job #111] 
route to PPj when it completes service at tne CEU. 


SEER ls 1oput. 


A vector used to store the positive values of the 
coefficient matrix. COEF{1i1) 18S the coetficient 
Clmnes ONO MN QatO state et NDE wi ije ln the g-tn balance 
eguaticn if NCON(j~1) + 1 S$ 1 § NCON(3). The values 
@aEe€ given to COEF, IND&xX and NCON in the main 
FOUtLInNe€. After the steady-state distribution has 
peen cetermined, some or the locations in COE? are 
used in subroutine ACCUM to accumulate the measures 


or system effectiveness. 


NEE + 13; the total number of DrocesSsSOrsS. Processor 


Goll s tie Gent ral server. 
Mae meen-imdicacLton Variable. Tes Value toemcnecked 
Sumanecwe cna IEFODlea If an uUnELxabDle error 15 


detected in the input or dizensions. 


MeveGctoOr suSed to store the State number of the terms 


t+) 


in the balance eyuations. See COEF. 


MMC Ond PEI Nt Inadlcators. —§ SCtCIng [P3AL = | wall 


Cause the Lalance equations to ba printed. 


a) 





IPLSTG A dimension indicatcr. IPLSTG should be set equal to 
Pic POmsenSlLOMmmOreLs Gsm AS LoitG iS being filled in, 
IPLSTG is tested to see that storage does not take 


place beyond the dimension of LSTG. 


feenOoo An oOftional print indicator. Setting IPPROB = 1 will 
' cause the steady-state probabilities to be printed. 
Only the first 1000 will be printed if NSTATE > 1000. 


[mrar AN Optional print indicator. Setting IPSTAT = 1 will 
cause the vector represertation and state number for 


each state to be printed. 


IP 1 MaOUnenslOnwladscator for NStG lang HSTG2. Pertorns 
for these vectors what LPLSTG does for LSTG. 


IP3 MeGimenslon LAdicator for NSTG3. ~See EPLSIG. 
IB4 A dimension indicator for NSTG4H and KSTG. s5ee 
PeLs i tG. 


ISTATE Vector representation for the left-hand side of the 
Dalance equations. AS the i-th salance eyuation 1s 
being generated, ISTATE contains the ISTATE vector 


Meprescental lon Cf tae i-ch State. 


VL ER A cunning variable which indicates the current 


precplem number. See NPROB. 


Memare Vector representation tor the right-hand side of the 
boamececueuddtions. As’ the i=th balance equation 15 
being generated, JSTATE contains, in succession, the 
ISTATE vector representation of state INDEX(J), when 
Secreta mers beiqd, £lilecd in, for cach j Erom NCO (i= 1} 
+ 1 tc NCON (i). 


Sie: 





LSaiG 


MP 


NCCN 


Tee U 


NDI 


NOCOEF 


NOr 


NEE 


NPxO3 


NEI 


N22 


po LATS 


Vector used for storage of the right subvectors. 


Vector used for storage of the left subvectors. 


Number of servers at the CPU (tapes model only). MP 


siykere aye en ae 


WieeN2 tie wCOtal un beE OL jJOobDS in the syste. 


AeeeGCI Miter yYector.  NCON({2) points to the end of theo 
Poaeneecadlanoc CyUuadtlon an) COERS and INDEX. Soe CCEF. 


The number of jobs at the CPU. 


Vee NCPUs the Number Of jJonS at tne PPP's. 


Medi mension andicator For COBF and INDEX. See 
meESic. 


A dimension indicator tor P and NCON. See IPLSIG. 


Mie mnuUnLeCENOL PP’S.™=) NPP is THosut. 


Tne number cf problems to be attempted at the current 


Ele NPROB 1S input. 


Number of states. Arter the states have been 
generated the first time, NSTATE 1s the total number 
meestateoemeer ior tO that tine, NSTATS 2s tue numser 


of states generated up to that time. 
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NSTG1 


NSTG2 


NSTG3 


NSTG4 


NTCT 


paCOEP 


N1 


N2 


RATE 


ARGO vereycetor. NSTGI(1) is the 


of the first right subvector whose 


A pointer vector. Use varies with 


A fointer vector. Use varles with 


MeECcCUNiter vector, —U 


N + NEP; 


representation of a State. 


Number 
NZCOEF 


NUMDEL 


Numbec 


ee 


of 


the Length of 


Va CiSS with 


UI 
m 


Tecation 


elements 


program. 


program. 


program. 


the ISTATE vector 


in no LG 


Sime to. a. 


MonmzeLEOmoleonomesceine ene coctficient matrix. 


Sone MeengGtueor COEF. 


boc. one JOUS nae s 1 aput. 


EyYpe-teo gOS. N2 is Tnput. 


A vector used to store the state proktabilities. 


metatrr xc Used tO SEOFe Ehe Service rates. 


os the mate £Eer type—-1i JobS at processor j. 


neat. 


4Q0 


RATE (i, 3) 


RAIE 1S 
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